ID 179 2S9 

AUTHOR 
TITLE 



IMS TIT ai ION 
SPONS AGENCI 

PUB DATE ' 
NOTE 

AVAILABLE ffiOM 



EDfiS PRICE 
DESCRIPTORS 



OCCQHSNT BECOHE 



SS oil 020 



IDENTIFIERS 



ABSTRACT 



Rim, Eui-Dc: Collar, Alan R. 

In" Search of •Nonlinear Process-Product fuEctions in 
Existing Schooling Effects Bata: I. A R^analysis of 
the first Grade Reading and flatheaatics Data Proa the 
Stallings and Kaskciiitz rolmu Through Study. 
Research for Getter SchoolsL Inc., Philadelphia, . 
Pa. / 

National Inst, of Educatioii (DHEW) , Washington, 

D.c, 

Aug 7 8 

134p.j Best copy available 

Research for E«tt€r Schools, Inc., UUU North Third 
Street, Philadelphia, PA 19103 ($7. CO) 

I1P01/PC06 Plus Postage. 

♦Academic Achieveien-^; *Analyfiis of Variance; 
♦Classroom Environment: ♦Classroom Observation 
Techniguesj ♦Ilementary School Mathematics; Formative 
Evaluation; Intervention; Measurement Technigues; 
♦Reading; Student Teacher Relationship; Time Factors 
(Learning) 

Linear Analysis: ♦Nonlinear Analysis; Project follow 
Through 



As an attempt to confirm the view that the 
relationships between certain classroom process variables and student 
achievement are curvilinear, first grade reading and lathematics data 
from t^e Stallings and Kaskowitz (197U) Project Follow Thrbugh 
Classroom Observation Evaluation weze, reanalyzed using orthogonal 
polynomial regression methods. Seventy-five classroom process 
variables were selected from Stallings and Kaskcwitz data e.nd entered 
into noly-noaial regression analyses. Thirty-two of ninety-five 
relationships tested were found to be nonlinear. (This, of course, is 
well beyond chance.) Fourteen of the nonlinear functions were 
guadratic in nature, eleven were cubic, and seven were guartic. 
fifteen of these functions were related to mathematics achievement, 
and seventeen were related to reading achievement. These results 
ge«.j^rally support the view that relationships between scne classroom 
process variables and student achievement are probably curvilinear. 
In turn, this finding seems to raise a question abcut recommendations 
for instructional improvement that are made based solely on linear 
analyses of process -product study data. This finding also provides 
additional support for the argument to employ both linear and 
nonlinear analyses in classroom process-product research. 
(Author/MP) 



♦ Reproductions supplied by EDRS are the best that can be made ♦ 

♦ from the original document. ♦ 
**************** **^iiii*iii****iiii^^i**^iik** ********** ***4f** ******************** 



ERIC 



U$ Oti^AIITMtNrOFHtALTH. 
• OUCATlONAWtLI^AIIt 
NATIONAL IMSTITUTC Of 
tDUCATlON 

'HIS DOCUMENT HAS BCfN RtP«0« 
OuCiO CXACTLV Ai> Rf-CElVfO H»OM 
THt PERSON OR ORGANi;ATfON ORlOfN- 
AT'NOtT POINTS or VlFW OR OPINIONS 
STATED DO NOT NfCCSSARUV RgPRf . 
SENT Of ♦ K tAl NATIONAL INSTtTUTE 0^ 
EDUCATION POSITION OR POl»< V 

. IN SEARCH OF NONLINFAR PROCESS-PRODUCT FUNCTIONS IN EXISTING SCHOOLING 
!:FF1:CTS data: I. A REA^^ALYSIS OF THE FIRST GRADE READING AND MATHEMATICS 
DATA FROM THE STALLINGS AND KASKOWITZ FOLLOW THROUGH STUDY 



Eui-Do Rim and Alan R. Coller 
Research for Better Schools, Inc. 



^ ^^J^ 

< 

Submitted to 
The National Institute of Education 
as part of a Final Report from 
The Basic Skills Component 
Research for Becter Schools, Inc. 

Suite 1700/1700 Market Street 
Philadelphia, Pennsylvania 19103 

••PERMISSION TO REPRODUCE THIS 
MATERIA*. HAS BEEN GRANTED BY 

August 1978 ^ 1 ^ ^ bui^k 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER tERICj." 

ihc proit»cL presenlod or reported herein was performed pursuant to 
.1 srant from the National Institute of Education, Department of 
lltMlth, IxUication, and Welfare. However, the opln*'^"^ expressed 
Iieiein do not necessarily reflect the position or policy of the 
WatioiKii Institute of Education, and no official endorsement by 
ine National Institute of Education should be inferred. 



Abstract 

As a part of a search effort for curvilinear process-product relation- 
ships, first grade reading and mathematics data from tha Stalling© and 

^ Ka.skowitz (1974) Project Follow Through Classroom Observation Evaluation 

were reanalyzed using orthogc:ial polynomial regression methods. Seventy- 

« five classroom process variables were selected and entered into poly- 

nomial regression analyses. Thirty-two of ^ninety*-f ive relationships 
tested were found to be nonlinear. This, of course, is well beyond 
chance. Fourteen of the nonlinear functions were quadratic in nature, 
eleven were cubic, and seven were quartic. Fifteen of these functions 
were related to mathematics achievement » and seventeen were related to 
reading achievement. These results generally support the view that 
relationships between some classroom process variables and studex.t 
achievement are probably curvilinear. In turn, this finding seems to 
raise a question about recommendations for instructional improvement 
that are made based solely on linear a^nlyses of process-product study 
data. This finding also provides additional support for the argument to 
employ both linear and nonlinear analyses in classroom process-product 
research. 
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I. 



INTRODUCTION 



V 



Improvement of the delivery of basic skills instruction to students 
has always been the preeminent goal of educational R&D. But as yet research 
has not found any luaovation of our educational system that consistently 
relates to outcomes in the traditional basic skills areas of mathematics, 
and reading. 



Nevertheless, new understandings regarding the relationship be- 
tween classroom practices and student achievement^ and of the change 
process itself, provide one with a measure of hope. Medley (1978), 
for example, has concluded that "where sufficient effort and resources 
have been applied to the study of teacher effectiveness, useful and 
dependable findings have emerged" (p, 22). And from the literature on 
change one learns that there is increasing reason to believe that e^^en 
the best of innovations will not succeed unless they are the achievement 
of joint efforts of practitioners and researchers, and are differentially 
employed by practitioners according to objectively determined needs at 
of intended use. 



One prerequL^tte to the improvement of basic skills instruction 
seems to be for researchers and practitioners especially — givea varia- 
tions in student characteristics and in the goals of instruction — to 
understand better how classroom practices can be optimized in order to 
maximize student achievement In mathematics and reading. In this respect, 
Luccke and McC; Inn (1975) have observed: 

For us, advancement will como tl^.rough an Improved understanding of 
what actually takes place in schools and classrooms. Studies using 
c*ducational production functions must attend more to variables per-- 
tinent to the educational production process, (p. 350) 
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In the last decade, well-designed and large-scale studies were im- 
plemented to examine the Instructional process in relkpect to student 
outcomes. Medley (1977) has listed fourteen of thssse process-product 
studies and there are even more* History is certain to applaud the ef- 
forts of all those associated with such research for it is already clear 
that their woik lias advar.ced greatly our understandings of teaching ef- 
fectiveness. Nevertheless, it is probable that some of the conclusions 
drawn from the results of those studies exclusively utilizing linear 
production functions are in need of reexamination for reasons soon to 
become apparent* Conclusions drawn from production functions which are 
positive, and linear would imply that "more is better" while a negative and 
linear function woula suggest that "less is better/* It is not unusual 
for the linear results of process-product research to be translated 
into a "tentative" set of recommendations for instructional improvement 
and then "universally prescribed*" Soar and Soar (1976) believe that 
these types of innovations axie limited: 

They are simplistic in implying that if some of a behavior is good, 
more is better; and once the q^uestion is raised, it becomes diffi- 
•cult to imagine very many behaviors for which increasing amounts 
would be unqualifiedly good* (p* 265) 



Tho Soars continue their argument by indicating: 

Advocates of change in teacher behavior do not often identify limits 
for the bahavior they recommend increasing or decreasing* There may, 
of course, be a small number of measures for which straightline re- 
lationships really are appropriate, such as negative affect* It would 
hot be surprising if increasing amounts of this behavior were in- 
creasingly destructive* But it seems doubtful that such relations are 
typica^i, as the use of product -moment correlation implies* (p* 265) 
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It has been advocated that nonlinear analysis should be performed 



along with linear analysis. Brophy«'and Evertson (1974), for example, 
concluded: 



The findings of- the present study . . . point to the need for rou- 
t^"ely investigating nonlinear as well as linear relationships be- 
,Ewoen teacher behavior and student outcomes. . . . The present study 
has shovm that many relationships which do not appear in correlational 
analyses are revealed when nonlinear analyses are p-^rformed, and, 
more importantly, that most teacher behaviors are related non-linearly 
to student outcome measures, (pp. 166-167) 

Soar and Soar (1973) reached a similar conclusion: 



The methodological implication of these data appears to be a strong 
argument for the lmport£.nce of analyzing classroom data interactions 
and nonlinear relations, since linear relations apparently represent 
only a small portion of the meaningful variance in classroom be- 
havior and its relation to pupil gain. (p. 1A9) 



Implicit in the above is the notion that linear production functions 
should not receive exclusive consideration in teacher effectiveness researcl) 
instead, researchers are urged to realize that some relationships more 
appropriately are described by functions reflecting the law of diminishing 
m.irginaJ productivity. Samuelson, for example, indicates that "some inputs 
relative to other fixed inputs will, in a given state of technology, 
cause total output to Increase; but after a point the extra output re- 
sulting from the same additions of extra inputs is likely to become less 
aud loss" (p. 52). The questions of concern here may be: How does stu- 
dent achievement clwnge with Increasing inputs of one classroom variable 
while all oLher variables remain fixed? And, are there optimal levels of 



a particular classroom practice that will tend to maximize student 
acuievement? This latter question leads us directly back to the issue 
of uonlinearity. 

A number o£ studies have reported nonlinear relations between maa-* 
sures of achievement and direct and/or proxy measures of classroom 
practices (e.g., Coats, 1966; Brophy & Evertson, 1974; Loucks, 1975; 
Soar, 1966, 196^, 1971, 1973; Soar & Soar, 1973). Soar and Soar (1976), for 
example, reported: ^ 

lionlinear relations were found between measures of achievement gain 
and measures of teacher behavior which appeared to represent teacher 
limitation of pupil freedom in the development of subject matter 
and thought, (p. 263) 

Elsewhere, (1966) reported that "intermediate levels of teacher 

control . ♦ . produced more pupil change in desirable directions 
than did extreme lack of teacher control" (p. 248). 

Of course, zdch findings as those reported above cannot be ignored 
by any new effort to assist practitioners to improve their basic skills 
instruction. Indeed, it would appear that recommendations for instruc- 
tional improvement based solely on linear relationships may not only be 
subject to some error but, mo<:e importantly, may inadvertently bypass 
some important process-product relationships. 

This secondary analysis effort should not be construed as strictly 
exploratory; sufficient evidence is now available to suggest that non- 
linear functions probably will be found in all large -^£ale process-product 
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research (e.g.. Soar & Soar, 1973). Nevertheless, this reanalysis does 
represent e attempt to confirm the view that the relationships between 
certain classroom process variables and stiident achievement are curvi- 
linear. Such additional evidence woulu not only clearly imply the use-- 
fulness of designing supervision and inservice training according to 
individually diagnosed teacher opportunities or needs, but would also 
^.''ovide some of the data that could be used by teachers for diagnosing 
and prescribing instructional modifications. 

It is this latter need that is at. the heart of this current re- 
analysis effort. It is proposed that both linear and curvilinear process-- 
product data sjj^uld be explored for their potential utility to improve 
instruction in basic skills. Important relationships could then be trans-* 
lated for teachers in a form they themselves can employ to discover op- 
portunities for self -improvement* A concrete example may be helpful* 
The Basic Skills Component of the avelopra^nt Division of Research for 
Better Schools, I.ic, is it), the process of field-developing models for 
assisting practitioners to improve their basic skills instruction. These models 
nssumo that practitioners can and should compare their own classroom prac- 
tices with reference functions (or tables) that relate the classroom 
practices of others to student outcomes. Practitioners not functioning 
u It^vols that insuro maxlmiim student achievement for a given combination of 
students and instructional goals would welcome the opportunity to modify 
either or both their behavior or classroom conditions* The use of both 
linear and nonlinear process-product functions derived from large-scale 
studies is seen as essential to this process. 
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Selecting Data Sets for Reanalysl a 

s' 

In selecting the Stallings and Kaskowltz (1974) data set for sec- 
ondary analysis, the following criteria were used: 

1. Only data sets from major studies of classroom process-product re- 
lationships were to be considered • In other words, each data set 
was to include classroom process variables and student achievement 
scores for a relatively large sample of classrooms. 

2. Data sets were to be constituted so as to provide for the computa- 
tion of residual scores* Such data sets were to contain student 
initial ability and end-of- treatment achievement test scores 

(or pretest and posttest scores) in the areas of reading and/or 
mathematics. 

3* Linearity of process-product relationships should have been assumed 
but not actually tested during the primary analysis. 

4. The data should have been collected from elementary graded (i.e., K-8) 
classrooms. 

5. Data sets were to be available for purposes of reanalysis. 

6. Data seta were to be easy to access* 

At least two data sets out of the sixteen major process-product 
studies identified met criteria 1 through 5. These were the Follow 
Through Classroom Observation Evaluation, 1972-1973 (Stallings & 
Raskowit?, 1974) and the Beginning Teacher Evaluation Study: Phase II, 
1973-1974 (McDonald & Ellas, 1976)- The Follow Through Classroom 
observation Evaluation data were available from SRI International 
(1. MLddleton, Follow Through Data Bank Manager), and the Beginning 
Teacher Evaluation Study, Phase II data, from ETS (F* McDonald, the 
principal Investigator). The Stallings and Kaskowitz data set 
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was chosen for reanalyze is primarily because it became available sooner 
than the McDcmal-' ;in4 Eli^s (1974) data set.' 

* The Organization of the Paper 

This paper Is divided Into six sections^ The se^pnd sectionals 
designed to provide an historical description of research employing • 
nonlinear methodology. It is essentially an annotated review* of such * 
studies, and no serious attempt has been made to analyze or synthesize 
the methodology or results* 

The third section briefly describes the Stalllngs and Kaskowltz 
(1974) study; methodology and results are described* The fourth 
section discusses the data and methodology employed for this reanalysls 
The results of the reanalysls are described and discussed in the fifth 
section. The sixth section summarizes the results* 



II. AN HISTORICAL REVIEW OF PROCESS-PRODUCT RESEARCH 
EMPLOYING NONLINEAR ANALYSIS 



In this section, studies ivvolving some form of nonlinear analysis 
of process-product related data are described. It is hoped that a sense 
of methodological developments In this area will become apparent, • 
althoughvno attempt has been made to synthesize either the techniques 
or ihe results reported herein. 

The R eview 

Perhaps the first researchers to '"test" for nonlinear process- 
product relationships were SoJ-omon, Bezdek, and Rosenberg (1963). 
Tliey related the behaviors of twenty- four teachers in thirteen 
adult-learning centers Lo studen^ hievement and attitudes in an 
introductory American Government course. Teacher classroom behavior 
was rated on two occasions in the middle of the. term by a team of 
observers using an instrument containing thirty-eight scales. At 
the same {?^.me, tape recordings were made and later analyzed with respect 
to the speech of teachers and students v/ith statements being assigned 
to broad categories, such as ''interpretation/^ "factual/' "organizing," 
"hypothetical," "opinion," and "personal preference"; teacher feedback 
to students was also analyzed. To complement the observational data, 
two questionnaires were employed to elicit additional information. A 
teacher questionnaire was used to obtain self-report data on teaching 
goals and motives for teaching. Students rated a broad range of 
tt^^acher behavtor;i and reported their attitudes toward the instructor. 



the course, the amount of learning, and the amount r " interest they 
developed. 

The four data-gathering procedures produced together 169 different 
items referring to the behavior of teachers. These variables were 
factor analyzed and yielded the following eight factors, which provided 
the basis for computing factor scores for classroom processes: (1) 
permissiveness vs. control; (2) lethargy vs. energy; (3) 4ggres8 > >•-»- 
ness vs. protectiveness; (4) "obscurity/vagueness vs. clarity/expressiva- 
ness; (5) encouragement of conpent-related student participation vs. 
non-oncouragement of participation/student growth emphasis; (6) dryness 
vs. flamboyance; (7) encouragement of students' expressive participation 
vs. lecturing; and (8.) warmth vs. coldness. 

0 The amount of learning acquired by students was. measured by 
administering a multiple-choice achievement teat at the beginning and 
end of tlie semester. The specially constructed test contained two 
Pvifts: one part measured factual information, and the other measured 
comprehension. Residual scores were computed, but because the corre- 
1 at ions between the residual scores and unadjusted gain scores were 
so high^ Solomon et al. decided to use the unadjusted gain scores as 
Indicauors of schooling effects. Attitudes toward the instructor, the 
course^ the amount of learning achieved > and the interest developed 
we IV assessed by use of the student questionnaire. Status attainment 
scores were used in the analysis of attitudes. 

Zero-order correlations were calculated to determine the association 
between the eight teacher factor scores and student achievement. On the 
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chance that some of these process*«product relationships might prove 
to be nonlinear, a series of 2 x 3 Chi-square analyses was conducted 
by dichotomizing student scores into high and low categories based 
on a median split and trichotemizing teachers into upper, middle, and 
lower thirds according to their scores on each factor^ Sixteen 
Chi -square analyses were computed for the combination of factor by 
test complexity (t.e.^ factual/concrete, comprehension/abstract). In 
addition^ the analysis of variance technique was used to assess 
context by process interactions. 

The Chi-square technique produced only one significant finding 
that Solomon et al. construed as possibly repres^enting a nonlinear 
outcome^ (Actually, a polynomial regression analysis would be needed 
to confirm the fact that the actual function is curvilinear, since 
the Chl-square process could distort the true relationship*) The 
rlassroorh factor found to be significantly related to gain in compre- 
ht^nsion was that of permissiveness vs. control. Other analysis revealed 
I hit iv^ins in factual information were related to teacher scores on 
rlar i ty/expressiv<mess and lecturing. In the judgment of Solomon et 
al., these latter two factors "represent behaviors and qualities of 
behavior which provide the most efficient way for a teacher to present 
and transmit factual material" (p. 6). 

Flanders (1970) indicated that "the main credit for identifying 
and conceptualizing nonlinear (or curvilinear) relationships belongs 
to Soar" (p. 403). This review of the literature supports this historical 
view. In the first of a series of chiefly process-product studies, in 
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which some form of nonlinear analysis was undertaken. Soar (1966) 
examined how a set of presage and process variables was related to 
student outcomes (Ke., products) in grades three through six. The 
staffs of four elementary schools, consisting of fifty-seven teachers, 
volunteered for the study. In the fall of the first year, data 
collection was begun with the administering of achievement, personality, 
and creativity tests to all pupils; a group test of problem-solving 
skills was also administered in each classroom. At about the same 
time, teachers were administered self-report personality tests. During 
the middle of the school year, classroom observations were conducted 
using Flanders Interactian Analysis and the South Caroliii^Observation 
RfCi^rd. In the spring of the first and second years, students 
were readmlnisl red the pretest battery as well as attitude measures. 

Through the use of analysis of variance. Soar examined the cumu- 
lative effect of different sequences of varying levels of classroom 
conditions over a two-year period. The four classroom process factors 
that had correlated most clearly with student growth the first year 
(i.e., ^'teacher criticism,*' "extended discourse vs. rapid teacher-pupil 
interchange," "pupil hostility vs. teacher support and pupil interest," 
and "indirect teaching vs. silence and confusion") were selected for 
study over the two years. Teachers were assigned to high, middle, and 
low categories on each of four process factors for each year. In this 
type of analysis, one type of curvilinear relationship (i.e., an 
Inverted U shape would be suggested by greater pupil growth for 
the middle positions relative to low and high categories, fhe four 
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process variables were studied in relation to five student measures: 
two achievement ♦ two personality, and one dealing with creativity. 
Student measures of residual true gain for the two separate years 
were numined in order to yield a total residual true gain for the 

two years of the project and, thus, served as the indicator of schooling 

i' 

effect tor this aspect of the study. 

Results of the teacher criticism factor across the achievement 
and creativity measures seemed to suggest that for these two types of 
measures high teacher criticism produced the least growth and that 
moderate amounts of teacher criticism were optimal. The two personality 
measures produced similar results. Soar interprets such findings as 
perhaps indicating "that at least a minimum of control of deviant be- 
havior is both necessary and desirable from the pupil point of view. 
Perhaps the optimum of teacher criticism is more than the least which 
Is represented here*' (p. 229). Another finding was that the trends 
noted above were clearer for the second year than the first. Soar 
telt that the data suggested "that what went on the year earlier 
matters less in the amount of growth shown over two years than the 
more recent influences do" (p. 228). 

For the indirect teaching factor in respect to achievement and 
porsonallty measures, the greatest desirable student change appeared 
at interm(*diate values of the factor. This was not the case for the 
creativity measure, where the optimal level for growth was associated* 
with a lower level of teaclier direction than was the optimal level for 
achievement and personality measures. Soar concluded: 
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Intermediate levels of teacher control, expressed either as 
ctlticism or as indirect teaching, produced more pupil change 
111 desirable directions than did extreme lack of teacher control. 
Perhaps the explanation is the need for the teacher to provide 
a minimum of structure within which pupil growth will be 
maximized. (1966, p. 248) 

In 1966, Coats (as reported in Flanders, 1970) reanalyzed 
Flanders Interaction Analysis (Flanders, 1965; Flanders et al., 
1%^) data collected during 1959-1960 and 1964-1965 by Flanders 
and his associates. Coats uncovered some curvilinear relationships 
that proved to be statistically .■significant. As indicators of schooling 
effects, Coats employed standardized ctatus attainment scores (i.e., 
achievement and attitude posttest scores) from twenty-nine self- 
contained classes, fifteen seventh grade English-social studies classes, 
and vsLxteen eij-hth grade mathematics classes. The independent variables 
consisted of pro test scores on the achievement -and attitude measures, 
a measuri? of intelligence, and twenty-seven classroom verbal interaction 
variables. Both regression and variance analyses were used in deter- 
mining the nature ind strength of associations between classroom processes 
and educational outcomes, with the classroom as the unit of analysis. 

Using polynomial regression analysis. Coats found that all signi- 
Meant process-product functions were essentially linear, with the 
i'xct^pt ion of seven that were quadratic and one that was ruble, 
r.tatist ic.ally signit lcant Inverted U-shaped relationships were found 
between teacher criticism (i.e., rostrictiveness, restrictive feedback, 
and noi^ativc? authority) and postachlevement scores for the sixth and 
seventh grade samples. The remaning curvilinear relationships Coats 

J3 
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plotted employed pupil postattitude as the dependent variable and 
sustained acceptance and preattitude scores as the Independent variables* 
The functional relationship between sustained acceptance and postattitudes 
may be described as a positively decelerating curve (i.e.> )• Preattitude 
was functionally related to postattitude in a shape that may be best 
described as a positively accelerating (i.e., ^) curve. 

Although they did not employ any cognitive measures as dependent 
variables, in 1968 Thompson and Bowers (as reported in Soar, 1972 ) 
related classroom process measures to creative growth in fourth grade 
pupils* One of their findings was that middle-^level teacher verbal 
output (as well as convergent teacher style) was associated with greatest 
i;rowth In total creativity. 

In another study. Soar (1968) argued that "there is an optimal 
level of teacher indirectness which is less than the maximum possible 
and an optimal level of teacher criticism which is greater than the 
minimum possible'* (p. 275). With this argument in mind, he asked: "Do 
all 'learning tasks have the same optimal levels of teacher behavior?" 
(p. 2/5). In an attempt to explore this issue. Soar reanalyzed data 
from his 1966 study. 

Using pupil data from the first year of testing. Soar 
calculated gtowth measures for reading, vocabulary, and creativity by 
ostimating true gain and adjusting the remaining relations with inlMal 
standing. Factor scores Cor indirectness of teacher control and for 
teacher criticism were? used along with the residual true gain scores 
to assess process-product relationships. Soar used a poljmomial 
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regression program to determine the nature of the relationships. 
Once the relationships were determined — and most of these functions 
seemed to be nonlinear — Soar tested for differences in optimal levels 
for the three growth measures that were assumed to vary in complexity .^.n 
the order in which they were listed above. 

The results tended to >^ui port Soar^s notion that differing optimal 
levels of lndirec:,ness would parallel differences in the abstractness 
or complexity of the growth measure. However, the results for teacher 
criticism were not as supportive. Soar concluded: 

Perhaps what these two sets of findings together indicate 
is that teacher behavior should shift materially in indirect- 
ness from concrete to abstract subject matters, but that 
all teaching should proceed under a relatively supportive 
emotional climate, (p. 278) 

Soar also suggested that effective teachers must be able to shift 
teaching styles as they shift objectives . He also indicated; 

The possibility suggested by these findings is that families 
of curves may be Identified which would specify the degree 
of directness which will produce most pupil growth for a 
given subject matter (or, more likely, for a set of immediate - 
objectives), (1966, p. 279) 

In the first of a series of reports (Soi^r, 1971; Soar & Soar, 
1972; Soar, 1973) dealing with the evaluation of Project Follow 
Through *s planned variation experiment. Soar sought both to describe 
observed differences among sponsored programs in terms of classroom 
behaviors and to relate those classroom processes to student outcomes. 
Obs*>rv;it ion« wero carried out ovor a two-year period in a sample of 
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kindergarten and firt^t grade classrooms selected from each of seven pro- 
grams and a comparison example. Fairs of observers spent a winter's day in 
each of seventy classrooms^ each observer using a different instrument (i*e* 
Teacher Practices Observation Record and Florida Affective Categories— 
1969, or Florida Climate and Control System~1970) and making "an audio- 
tape, which was later coded on two other systems (i*e«, Reciprocal 
Category System and Cognitive Taxonomy) • The four systems recorded 
such things as the teachers' classroom management techniques, .expression 
of affect, and the social-emotional nature and cognitive level of the 
interaction. In addition to these instruments, observer^ "globally" 
rated the classroom climate and objectively described the contexts 
The results from each instrument were factor analyzed and reduced to 
process factor scores* The factor scores were then tested for differ- 
ences between programs by the multiple range te^t and related to student 
outcomes by grade ^nd year of observation* 

The set of pupil achievement measures, administered yearly by 
Stanford i^searcH institute (to a portion of the classroom observed), 
differed somewhat across the two years in which classroom data were 
collected. Scores from the various tests were factor analyzed by Soar 
ami reduced to three subscores representing simple-concrete, skill, and com- 
P Lex-'abatract ac;hievement . These scores themselves were reduced to 
reviresiscd gain scores and were used as the indicators of schooling ef- 
ItHts. For each grade, classroom means were calculated for the three 
product measures and were relate^d to all of the factor scores derived from 
the observational data. 




In general, Soar (1971) found highly significant dlff^irences in 
classroom behavior associated vith differences in program sponsorship. 
Subscores representing simple-concrete, skill, and complex-abstract 
student growth did not relate strongly with each other, bt»t did seem 
to relate differently to the various dimensions of classroom behavior 
and to the different programs. 

Despite the above. Soar found, that the relations of the obser- 
vational measures to student growth were scattered and often inconsis- 
tent. He attributed this failure to the unreliability of the achieve- 
ment meaciures used and to the small number of classrooms available for 
analysis at each grade level. Soar, citing mainly first grade data 
for the first year of data collection, spoke to the results of tests 
of linearity. He reported finding a number of nonsignificant but 
Inverted U-shaped functions and suggested that certain process varjLables 
may relate to student growth in a nonlinear fashion. He indicated 
that "t'his could account fc. the lack of relation cited above, and 
for both lowered correlations and inconsistent ones from grou*- to 
group" (p. iv). 

la iM third year of his evaluation-research of Project Follow 
nirough. Soar (197 3) again soug.it to describe differences among sponsored 
piogr»uns In terms of classroom behavior and to relate those classroom 
^aocesscs to student outcomes. Observations were carried out in a sam- 
i)le of kindergarten, entering first grade, continuing first-grade, and 
second grade classrooms selected .from eight s p ons o re d-* prog rams and a 
comparison samplu. As before, pairs of observers spent a full winter's 
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day in each of 289 classrooms vith each member using a different instru- 
ment and making an audiotape, which was later coded on two other systems* 
The four systems, which are the same as described in Soar (1971), 
recorded such things as the teachers' classroom management techniques, 
expression of affect, and the social-emotional nature and cognitive 
leve'. of the interaction. Classroom climate and an objective description 
of the context were obtained from the use of two other instruments. 
Soar and his associates also conducted a substudy involving twenty 
teachers who had been either high or low in the coerciveness of control 
of pupil behavior the previous year. 

For all three substudies the same set of observations was made. 
The results from each instrument were factor analyzed and reduced to 
factor scores. These factor scores were. used . to test for differences 
between programs by use of the multiple range test. In addition, 
highly loaded items from the separate analysis of the instruments 
were factor analyzed, and these eleven factor scores were treated by 
profile analysis to group teachers with similar profiles. In turn, 
wSoar explored the relation between programs and teacher profiles and 
between teacher profiles and student outcomes. In another aspect 
of the study, factor scores were related to student i^utcomes by grade. 

In the major st;udy» highly significant differences in classroom 
behavior were^ found to be associated with differences in program spon- 
sorship, as well as differences among grade levels. Soar reports that 
"of the 39 factors produced from the six instruments, 36 either dis- 
criminated between sponsors or between grade levels'* (p. xxi) . He 
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concluded that "the measures possess considerable discriminating power, 
and also that sponsors have been successful in creating very different 
milieus for learning" (p. xxi) , 

The set of pupil achievement measures administered by Stanford 
Research Institute differed somewhat across grade and testing periods. 
As before, subtests from the various tests were assigned to categories 
representing simple-concrete, skill, and complex-abstract achievement. 
A close examination of the data revealed that for some pupils a 
ceiling effect was apparent, and Soar elected to eliminate such students 
from the analysis. Unlike the earlier study, regressed gain was cal- 
culated separately by socioeconomic status and ethnic group. 

Soar reports linear relationships between classroom p,rocesses and 
student outcomes, but allots very little space for discussing' nonlinear 
relationships: "when curves were plotted for the current data. Inverted 
'U' s were found in some cases, ijut upright 'U' s were found at least 
as frequently" (p. 202). Soar notes that some of the third-year 
curvilinear findings differed from prior findings. In response to 
this, he discusses the methodological and sampling differences from 
study to study and suggests that such differences could possibly account 
for discrepancies in findings. One should note that, in a review 
of curvilinear findings across four of his studies (Soar & Soar, 1976), 
the results of thi.s third-year study were ignored while the earlier 

In a study concerned with t)xe relationship between classroom 
behavior, pupil characteristics, and pupil growth during the school year 



and over the sununer, Soar and Soar (1973/1975) made the following 



predictions : 



1. Measures whica li'ijresent teacher control or structuring of the 
classroom are likely to be related to pupil cognitive growth 
in nonlinear fashion. " 

2. The point on the ^lasspooiu behavior dimension at whicli max- 
imuta pupil growth occurs is hypothesized to shift with the 
complexity or abstract?ness of the learning objective, vith 

the maximum growth of more abstract objectives being associa.ted 
with less teacher control than will be true for more concrete 
objectives. 

'3. lorsonal characteristics of the pupil such as socio-economic 
status, anxiety, dependency or impulsiveness will influence 
(interact with) the level of classroom behavior which 1$ op- 
timal for pupil growth in a particular learning task. (p. 10) r 



Eighty-one fifth grade and twenty-one first grade classrooms were 
visited during the late fall and winter by pairs of observers who 
collected data for the same four observation systems and classroom rating 
measures as were described in Soar (1971). The observational data were 
factor analyzed and eventually reduced to a set of eleven factor scores: 
negative control vs. orderly classroom; teacher control, varied inter- 
action; expansive teaching; pupil initiation; free movement and positive 
affect vith little focus; te&cher choice of problem; seat work without 
teacher; unnamed; higher level cognitive activities; teacher extended 
lecture; and recitation. All students were administered a fall pretest 
battery, a spring posttest battery, and a second posttest battery the 
next fall. Fifth graders were administered achievement tests in reading, 
vocabulary, spelling, and arithmetic concepts; personality tests for 
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dependence, anxiety, school achievement motivation* locus of control, and 
impulsivity; a creativity test; measures of attitudes toward self 
and school; and an ig measure. The battery administered to first 
graders consisted of two achievement tests and measures of self- 
concept and Impulsivity. Pupil data were reduced by calculating .a 
regressed gain measure that regressed posttest score on pretest score 
f jr subgroups of pupils identified by IQ level, sex, and race for 
the fifth grade and by SES, sex, and race for the first grade. 

Due to legislated changes, the fifth grade school-year and 
summer process-product substudy involved only fifty-nine classrooms. 
Classroom process factors and a priori composites were correlated 
with student outcomes. The factor scores were then used in stepwise 
multiple regression to explore Interactions and nonlinear relations. 
Significant nonlinear results were tested separately and plotted by 
polynomial regression analysis. If the plot suggested an upiright or 
inverted U, the significance of deviation from linearity was tested. 
Tarallel procedures were used to study school-year and summer growth 
for the first grade sample. 

KosuUs ft>r the fifth grade school- year substudy revealed tiiat 
approximately o<jiial numbers of siKniftcant zero-order relations were 
loana for coKuiLive and noncognltive variables, and "the nonlinear and 
ill! tMM( Lion analyses accounted for relatively larf^er numbers of sig- 
nifLcani re Jai iouships tlian the Iinc<ir analyses did (a ratio of 1^5 
to A)'* (p. 143). 
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^ Recitation did not relate linearly to the criterion measures but 
did relate in a strongly noulfnear fashion to s^c^veral measures of achieve- 
ment and self -concept* An examination of the curves revealed that 
intermediate values of recitation were functional, but either too little 
or too much was not* Soar and Soar indicated that there was limited 
support for the "differentiated U hypothesis/* the second of their 
predictions* In summarizing their results Soar and Soar stated: 

The integrating thread, and an Implication for teaching, appears 
to be the conclusion that there is an optimum level of structure 
and control In the classroom, whether by an Intermediate value of 
one'*behavior or a combination af a behavior that structures and a 
behavior that does not, which has desirable outcomes for pupils, 
both cognitive and noncognitive. (p. 143) 

• * • - 

Results for the summer substudy indicated that the number of linear 

relations did not exceed chance expectancy, but that nonlinear and inter- 

active relations were more than four times the amount expected by chance. 

Pupil initiation was nonlinearly related to student growth over the summer. 

Results for the first grade isubstudy showed that achievement gain 

was related to moderate atnounts of task focus in a. positive* climate 

and to a proper match be*tween task difficulty and pupil ability. Self'- 

concept growth was related to intermediate amounts of gentle control in 

a positive cUnwite. Over the summer, self-concept was related to 
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intermediate levels of gentle control. In reflecting on their results 
Soar and Soar suggested: 

The methodological implication of these data appears to be a strong 
argument for the importance of analyzing classroom data inter- 
actions and nonlinear relations, since linear relations apparently 
^ represent only a small portion of the meaningful variance in class- 
room behavior and its relation to pupil gain. (p. 149) 

Soar and Soar (19 76) reviewed four of their studies (Soar 1966, 
1968; Soar J. Soar,T.972; Soar & Soar, 1973) in an atten5>t to identify 
consistent tteasures of teacher effectiveness. They reported that in 
all four studies nonlinear, inverted U-shaped relations appear "to 

♦ 

represent teacher limitation qf pupil freedom in the development of 
subject matter and thought" (p. 263). In three studies differentiated 
U-shaped relations were found, indicating that "different kinds of 
pupil learning varied in the amount of teacher structuring and limit 
setting which was associated with greatest pupil gain" (p. 261). In 
discussing these findings Soar and Soar, argued? , • 

' Although linear relationships have most often been used in studies 
of teaching effectiveness to identify relationships between class- 
\ behavior and pupil gain, it seems clear that they are limited 

-tn the extent tq which they can help us answer the question of 
what good teaching is. they are simplistic in implying .that if 
some of a-behavlo*-. is good, more is better and once the question 
is raised, ic becomes difficult to imagine very many behaviors 
for which increasing' amounts would b« unqualifiedly good. (p. 265) 



A related issue is that of ^'universal prescriptions" for increasing 
teacher effectiveness, which the Soars believe is of questionable use. 

In the studios thus far reviewed, it is perhaps safe to say that 
the sheer number of nonlinear process-product functions reported has not 
necessarily been overwhelming, considering all of the classroom behaviors 
that were examined. In part, it is the result of methodological choices — 
for example, as when Soar (1968, 1971, 1973) only reports quadratic 
functions liaving clear inverted or upright U shapes, or when he reduces 
large batteries of outcome measures to only three levels of cognitive 
complexity, or when large quantities of classroom data are reduced by 
him into factor scores. From prior research one comes away with the 
Impression that there are a few highly consistent nonlinear findings. 

This impression, however, changes dramatically when the nonlinear 
data reported by Brophy and Evert son (1974b) for the Texas Teacher 
Effectiveness Project are examined closely. In th«lr report of 
the roanalyses of presage-process-product data previously analyzed 
In terms of i:ero-order correlations (Brophy & Evertson, 1974a), Brophy 
and Evertson (19 74b) present some 15,000 functions or coefficients. Of 
these, so many are clearly nonlinear that it is not easy to come away 
from the data without a strong belief in the need to employ nonlinear 
analysis in process-product research. 

The Texas Teacher Effectiveness Project was a two-year, replicated, 
naturalistic-correlational study of the relationships between presage 



24 

28 



and process variables and student growth In the second and third grades. 
Only those teachers whose "teachier effectiveness" was stable over a 
three-year period were observed. Thirty-one teachers were included In 
the first year of the study and twenty-eight in the second. Four obser- 
vations by observer pairs were made the first year and fourteen the 
second year. Both low and high inference measures were used to assess 
teacher behavior: the Brophy-Good Dyadic Interaction Observation System, 
Eminer and Peck High Inference Rating Scale, High Inference Coder" Check- 
list Variables, Time Utilization Measures, High Inference Coder Ratings 
of Teacher Characteristics, Coder Ratings of Lesson Presentation 
Variables, Low Inference Process' Variables, etc. Five subtests from the 
Metropolitan Achievement Test (MAT) served as criterion measures; residual 
gain scores were used as the Indicator of schooling effects. 

The data were presented, where appropriate, in terms of year of 
study, SES, and MAT subtest. It is not possible here to sumnarize even 
a fraction of Brophy and Evertson's findings; however, it is meaningful 
to review their conclusions regarding nonlinear analysis: 

• 

The findings of the present study . . , point to the need for routinely 
investigating nonlinear as well as linear relationships between 
teacher behavior and student outcomes. . , . The present study 
has shown that many relationships which do not appear in corelation- 
al analyses are revealed when nonlinear analyses are performed, and, 
more Importantly, that most teacher behaviors are related non- 
linearly to student outcome measures. (pp. 166-167). 

Among the more recent studies using nonlinear analysis is the NIE 
funded study of Calkins, Godbout, Poynor, and Kugle (1976). Calkins and 
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his associates explored methodological Issues and problems relevant to 
teacher behavior research. These researchers interested themselves 
primarily in examining relationships between variability of teacher be- 
havior (i^e*, the variance of the distribution of values of observed, 
teacher behavior) and student achievement as measured by a series of 
mathematical subtests. More specifically, it was the intent of the 
study **to investigate the linear and quadratic contribution of the mean 
and the variance of the distribution . • « as pi.-'ictors of student 
achievement" (p. 3). 

Process data w^^re collected in thirty-two high-SES fifth grade 
classrooms by use of the Global Rating Scales (GRS) and the Teacher 
Practices Observation Record (TPOR)-Miigh and low inference instru-- 
ments> respectively. Observation data were obtained during the spring 
semester in three sessions of math instruction* These data were processed 
by obtaining a, mean and a variance for each scale for each teacher by 
collapsing the data across the three observation periods* 

Student achievement data were collected on project-designed in- 
struments during fall and spring Instructional periods. Tha mathematics 
test consisted of a total of thirty-three multiple-choice items designed 
to assess six content areas. A multiple regression technique with 
protest performance being entered first was used to obtain correlation 
data. 

In a discussion of their results. Calkins et al. indicated: "Slnrc 




^ the number of statistically significant relationship's is so low, it is 
probably unwise to interpret these results as evidence of 'real* re- 
lationships, as they could conceivably all be Type I errors" (p. 16) » 
An examination of results reveals that, for the mean as a statistic, 
only 1 out of 77 quadratic analyses of GSR data was significant at the 
.05 level oi confidence, and only 12 of 4 34 quadratic tests involving 
the TPOR data reached significance. For the variance as a statistic, 
the results respectively were: 2 out of 77 and 12 out of 434. 

Because of the above findings. Calkins et al. did not attempt to 
Interpret. their results. But it Is of some interest to note that 
fifteen of the twenty unique TPOR items that Calkins et al. found to be 
significantly linearly related to outcomes were also the same TPOR 
factors that Soar (1973) found to be usually significantly related to 
"skill" learning; ten of the eleven nonlinear relationships ijrere simi- 
larly related to "skill" learning as defined by Soar. Since one could 
interpret the mathematics tests used by Calkins et al. essentially to 
be tests of skill, it would appear that their results are not without 
some support from prior research In effect, there appears to be some 
measure of consistency beti*een the findings of Calkins et al. and those 
of Soar (1973), which suggests that the. results of Calkins et al . should 
be reRarded a.-j due simply to chance. Of course, ^ven this observation 
must be tempered by the exploratory nature of this latter analysis. 




Tests of linearity have also been used to assess the nature of 
process-product relationships when classroom observationa were not 
employed and teacher self-reports were the only source of data (Loucks, 
1975). In this instance, self-report data serve as proxies for data * 
collected by use of direct observation. Loucks (as reported in Hall a 
Loucks, 1977), in exploring the relationship of "Level of Use" (i.e., 
the level or stage at which an innovation or treatment is being imple- 
niented) to schooling effects (i.e., achievement in mathematics and 
reading), reanalyzed data collected by Watkins and Uolley (1975) 
concerned with teacher self-reports on issues related to individualiza- 
tion of instruction in the classroom. 

In the original study, a total of 134 second and fourth grade 
teachers in twenty-two schools were interviewed in respect to Level of 
U.ie of certain concepts related to individualization. Teachers in ele- 
ven of the schools that had officially implemented Individually Guided 
Education (IGE) were assigned to the ICE group; the remaining teachets 
were assigned to the non-lGE group. Based on interview data, teachers 
were classified as to one of eight possible Levels of Use categories: 
(I) nonuse, (2) oriuntation, (3) preparation, (4) mechanical use, (5) 
routine use, (6) refinement, (7) integration, and (8) renewal (Hall d 
Loucks, 1977). Loucks (1975) reports that conventional comparisons of 
achievement between the ICE and non-ICE groups, using one-way analysis 
of variance, did not result in any significant differences between 
groups regardless of subject area or grade level. 
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A reanalysis of the data on the basis of user and nouuser categories 
resulted In an altogether different set of outcomes. For example, 

For the second-grade sample, results of analysis of variance 
indicated that all users of individualized reading showed 
significantly greater achievement than all nonusers; there were 
no statistically significant achievement differences between 
users and nonusers of individualized mathematics. (Kali & 
Loucks, 1977) 

By breaking the Levels of Use dimension into rooro discrete categories, "the 
question of whether the pupils of teachers at some Levels of Use have 
greater achievement than those at other levels was explored" (Hall & 
Louckas, 1977). Loucks (1975) used a test of linearity on the second 
grade sample using raw status attainment scores (i.e., postachlevement 
scores in mathematics and reading). The analysis indicated that second- 
order curvilinear relationships (i.e., quadratic) provided the best flc 
for teacher Level of Use of individualized instruction and student 
achievement. 

The relationships between Level of Use and achievement in mathematics 
and reading differed, however. The curve for mathematics is best des- 
cribed as J-shaped; that is, the mathematics achievement scores gradually 
increase from some midpoint in Level of Use. The curve for reading is 
best described as inverted U-shaped, that is, reading achievement in- 
creases gradually until it peaks at about the midpoint in Levels of Use 
and then decreases gradually. (It should be noted that it is possible 
that the reported analyses of variance results are in error, or less 
likely, that the curves are mistitled. We were unable to confirm this 
suspicion at the time of this writing.) 
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Suipmary ' 

Solomon, Bezdek, and Rosenberg (1963) were perhaps the first to 
explore the issue of nonllnearity in process-product research. , They 
found that in adult learning centers an intermediate level of "permis- 
siveness" produced higher levels of achievement gain than did either 
extreme. Soar (1966) * who must be given credit for bringing nonlinear 
analysis methodology into the mainstream of process-product research, 
found a "differentiated" nonlinear relationship between classroom pro- 
cesses and various student outcomes differing in complexity. More 
specifically, he found that different amounts of teacher control appear t< 
be optimal for growth in tasks differing in complexity. Higher levels of 
teacher control are needed for optimal growth in relatively concro.te- 
tasks than are optimal for more skill-related tasks, and a still lower 
level of control Is optimal for growth in creativity. 

In 1966, Coats presented analyses showing nonlinear relationships. 
Thompson and Bowers (1968) also reported nonlinear results, but for 
creative outcones^ In a reanalysis of hla 1966 data. Soar (1968) again 
found indications of nonlinear relations • Then in a series of studies 
dealing with Project Follow Through programs (Soar, 1971 > Soar & Soar, 
1972; Soar, 1973), more nonlinear results were reported* These findings 
were supported by the results of the Soar & Soar (1973) study of school-- 
year and summer student growth* 

The Brophy and EvertBon (1974b) study is perhaps unique for the shee 
number of nonlinear results reported. Their results contain a compel] Ing 
number of nonlinear functions* 
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Among the more recent studies using nonlinear analysis is that of 
the NIE-funded Calkins, Godbout, Poynor, and Kugle (1976) study, which 
explored methodological Issues related to teacher effectiveness, as 
well as that of Loucks (1975), which used proxy process data to study 
"Level of Use." 

It should be clear from the foregoing that researchers have become 
increasingly sophisticated in the use of nonlinear methodology. For 
example, Chi-square and analysis of variance techniques were used in 
early studies to infer curvil inearity; nowadays, polynomial regression 
analysis is employed instead. It is also interesting to note that 
many of the studies reported above represent secondary analyses of 
data collected earlier, often by other investigators. 
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III. THE STALLINGS AND KASKOWITZ STUDY 

In their report, Stallings and Kaskowitz (1974) addressed two 
questions of educational importance: (1) Has a variety of in?)ortant 
educational programs (Planned Vaiiation) been implemented in diverse 
sites across the country? and (2) If these educational models have been 
installed, how have they affected the growth and development of children? 
Included in the study were seven models representing a wide range ot 
innovative educational theories: two behavioristic models (the University 
of Kansas and the University of Oregon) , a model based on the Piagetian 
theory (High/Scope), a model based on the opeA education theory 
(Education Development Center), and three other models, each having its 
own particular combination of theory and practice drawn from Piaget, 
Dewey, an-l the English Infant Schools (Far West Laboratory, University of 
Arizona, and Bank Street). Approximately twenty first grade and twenty 
third grade classrooms for each of seven Follow Through sponsors at five 
or more sites per sponsor were sampled for the study. Since the class- 
room implementation of Follow Through programs was to be evaluated in 
terms of the significance of differences between each Follow Through 
sponsor's classrooms and Che non-Follow Through classrooms, thirty-five 
first grade and thirty-six third grade non-Follow Through classrooms were 
also included in the study. 

The Follow Through Classroom Observation Instrument and other pro- 
cedures were used in collecting observation data that provided the basis 
tor assessing: (1) the extent of implementation of the sponsor's 
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models t (2) the relative exportablllty of the models » and (3) the relation 
ship of classroom process and. child outcomes* The Classroom Observation 
Instrument contains three major sections: (1) the Classroom Summary 
Information (CSX) section, (2) the Physical Environment Information (PEI) 
section, and (3) Classroom Observation Procedure (COP), which consists of 
three parts — the Classroom Check List (CCL), Five-Minute Observation 
Preamble (PRE), and Five-Minute Observation (FMO). Trained observers 
collected data on three separate occasions for a full day each time. The 
first two days were devoted to activity/adult^focused observations and 
the third day was used for child-focused observations. The CSI and PEI 
were con^leted once and the remaining schedules were coiq>leted four times 
an hour. 

Classroom Implementation 

\ Program implementation in the classroom was judged on the basis of 
*two criteria: (1) the extent to which sponsor *s classroom were found 
to be uniform on selected implementation variables, and (2) the extent 
to which a sponsor's classroom differed from the traditional non-Follow 
Through classrooms in the same v<*,riable. Stallings and Kaskowitz 
developed a list of variables that were descriptive of each sponsor's 
model, and associated the variables with specific items in their 
systems. A pool of non-Follow Through classrooms was used in estab- 
llahlng standards via a nonparametric scaling technique* For each 
sponsor's classroom, an implementation score was confuted for each of 
the sponsor's variables by referring to the standards established on 
the basis of non--Follow Through classroom data. These scores were then 
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used for further analyses. 

Stalllngs and Kaskowitz found that the great majority of teachers 
were conforming to sponsor specifications in implementing programs. In 
addition, the sponsored programs could be distinguished from each other 
along iinportant classroom practice dimensions. 

In structional Processes and Child Outcomes 

> 

Using 108 first grade and 58 third grade Follow Through and non- 
Follow Through classrooms for which baseline test data on the Wide Range 
Achievement Test (WRAT) were available, partial correlations between 
classroom means on instructional processes and scores on the Metropolitan 
.Achievement Test (MAT) were computed holding WRAT scores constant. 

Stallinga and Kaskowitz reported that high reading and math scores 
were associated with more-structured, teacher-initiated classrooms (in 
both first and third grades), small group instruction (for first grade), 
large group instruction (for third grade) , positive corrective feedback, 

and the time children spent on reading or math activity. 

' , ! 

Stepwise regression analyses were performed to assess the amount of 
variance accounted for by process variables, beyond that which was 
accounted. for by the WRAT, by entering the WRAT score first in the re- 
gression equation. The WRAT score explained 17 .to 50 percent of the 
variances of the MAT first and third grade mathematics and reading 
scores. A set of ten process variables in th6 first grade and eight 
In the third grade accounted for an additional 43 to 64 percent of the 
mathematic score variances in the first and third grades respectively. 
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Eight process variables accounted for an additional 23 percent of the 
reading variance In the first grade, and seven process variables for 
37 percent in the third grade. 

Based on those findings, Stallings and Kaskowitz concluded their 
study thus: 



The Follow Through program of planned variation is being 
implemented, and . , , the' seven sponsored models considered in this 
report are each working to the advantage of children-r-not by chance 
but by careful design, (p. 346) 
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IV. ME-rtlbDOLOGY FOR THE REANALYSI^ 

t 

Technical aspects of the current secondary analysis of the 
Stalllngs and Kaskowitz (1974) f j^rst grade data are described In this 
section. First > the data set is described^ and second > mechodology 
and procedures used for the data reanalysls are outlined* 

Data 

1 « 

It was orginally intended that this reanalysid would only deal 
with a subset of the Stalllngs and Kaskowitz data. Data either from 
the , first or third grade were to be analyzed only for a limited set 
of the classroom variables. Further limitations were caused by data 
Inaccessibility, time, and budgetary constraints. For example, it 
was the authors' intent to utilize Individual student data to calcu- 
late residual scores for some part of the reanalysis. 's it turned out 
the author's initial plans were changed because student data vere 
not readily accessible and were too costly given budgetary limits. 
One other consequence of not obtaining individual student data was 
the inability to relate selected classrooL' x^ariables to measures 
differing in complexity within an achievement area; the scores 
readily available from SRI International were only for tota l mathe- 
matics, total reading, and word analysis. 

Data tapes at SRI International were in binary mode and thus 
suitable for a CDC 6A00 system but ::^ot for tite IBM/370 system employed 
by RBS. It became necessary to convert the Stalllngs and Kaskowitz 
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Residuallzlng M AT Mean Scores on WRAT Mean Scores 

i^ne way of statistically controlling for unequal initial ability 
is to employ residuali^ed scores (e.g», Bereiter, 1963; McDonald & 
Elias, 1:^74) • In an analysis of Project Follow Through, Soar (1973) 
employed residualised scores; but to deal with the problems of group 
differences, he calculated separate residualized scores for subgroups* 
However, due to the lack of accessibility of data at the individual 
student level, subgroup residualized d "^es could not be computed for 
this reanalysis. Residualized scores were computed by regressing MAT 
class means on WRAT class means* This latter approach enabled the 
results of this reanalysis to be compared with the results from the 
Stallings and Kaskowltz primary analysis* 

Statistical Analysis 

In keeping with the Stallings and Kaskowif** study, the reanalysis 
was performed on the basis of data from the 108 classrooms that 'had 
both WRAT and MAT scores and an attrition rate of less than 80. percent* 
The following set of steps was employed for the reanalysis: 

/ 

Step 1* Classroom mean scores on MAT Reading and MAT Mathematics were 
regressed on WRAT mean scores, and residual mean .Scores were 
obtained^ 

Step 2* Residual mean scores were matched and merged with classroom 
process variables, and each classroom process variable-- 
reoidual-mean-score pajr was plotted (with a missing data 
option), using the SPSS Scattergram Analysis program (Nie, 
Hill, Jenkins, Steinbrenner , & Bent, 1975X Zero-order cor- 
relations were produced as a by-product of this program* 
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data from the biliary mode to a "character" mode to make It compatible 
with RBS^s systems* The time and costs involved In this activity also 
l&d H:q a number q£ trade-offs from original intentions: fewer variables 
„e.e sexeoeea .... r.^..ysU ana .U ..a ana^s. aaCa „«e e.clua.a 
from the study. 

A total of r>eventy-f ive variabiles, selected from the Stallings 
and Kaskowltz data, were converted into a "character" mode and reanalyzed* 
These variables were selected on the basis of their compatibility 
with RBS*s intentions to assist states to improve basic . skills Instruc- 
tion* The selected variables ^re listed on Tables 1 through 11; 
the Identifying numbers included there are those, used by Stallings 
and Kaskowltz In their report* Only total mathematics and total 
reading scores were employed as criterion measures for this reanalysis* 

Data from 108 first grade classrooms out of ^ the original set of 
171 (for which observation data were available) were retrieved for 
reanalysis using the same selection criteria Stallings and Kaskowltz 
used: (1) both the WRAT and MAT had to have been administered to the 
class, and (2) the attrition rate from fall to spring testing must have 
been less than 80 percent* Data meeting these requirements were analyzed 
according to the procedures described below* 

Methodology and Piocedures 

This section describes the methodology involved in computing 
reslduallzed scores and the steps involved in the statistical analysis* 
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Step 3. Each scat terp lot was examined for the appearance of non- 
linear relationships. 

Step 4. Upon inspection, fifty-three of the original seventy-^f ive 
variables seemed to be possibly nonlinearly related to 
either reading residual mecm sdores or ixiatKanatl^^ 
scores and therefore were entered into the polynomial 
regression analysis* The BMDF5R program (Dixon > 1975) was 
used because it gives a summary table of goodne8S*-*of-**f it 
statistics and scatterplots of observed and predicated values 
in respect to the independent variable (process variable). 

At first, each process variable (X;^) was raised to the fourth 
power term (Xf^) and entered into the regresaio'. analysis. The 
form of the regression equation was: 

Y. = + B,X. + BnX.^ + B„X-^ + B.x/ + e- 

^ 0 It 2 t 3 % 4 V % 

Step 5. A summary table of goodness-of-f it statistics for each fitted 

polynomial was reviewed, and those process-residual mean score • 
pairs that showed the best fit at the second or third degree 
were reanalyzed to the degree of the best fit (see Ker linger & 
Pedhazur, 1973, p. 213). The square of the multiple correlation 
(R^) and the multiple correlation at th^ best fit degree were 
computed from the summary table. The b^st fit polynomial function 
was traced on each of the scattergrams. 



Step 6. Since zero-order correlations between residual mean scores and 
: process variables are known to be equivalent to partial 
correlations between posttest mean scores and process variables 
using the pretest mean scores as a covarlate (Linn & Slinde, 1977), 
it follows that the zero-order correlations obtained for this 
reanalysis should be equivalent to Stallings and Kaskowitz^s 
partial correlations* A comparison of the correlations from the 
two analyses was made in order to check the accuracy of the 
analysis. The results of this comparison reveal that in only 
four of the instances in which data were available for com- 
parative purposes was there a discrepancy greater than .02 (an 
acceptable level of divergence, given rounding errors). Perhaps 
the remaining differences are due to the use in this reanalysis 
of a missing data option* 
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V. RESULTS OF THE REANALYSIS AND DISCUSSION 

in Section V, tne results of the polynomial regression reanalysis 
oL" delected variables from the first grade subset of Stalllngs and 
i<.aHkowitz's iOS-classroom data set are presented. In order to discuss 
the results in a nteanlngful way, the selected classroom process variables 
are grouped according to the categories (or constructs) developed oy 
Kuff (1978). Tlius, the discussion of the reanalyses and the accompany- 
ing tables is organized under the following constructs; time, instruc- 
tional organization, monitoring, management, teacher questioning, teacher 
reactions to pupil response, pupil response patterns, teaching activi- 
ties, structure/control, feedback, and qualities of environment. Under 
each construct, the results are generally presented in the order: con- 
struct description, listing of included variables, presentation of analy- 
sis results, interpretation of the results, and discussion. Since re- 
views by Rosenshlne (1966, 1967) and by Berliner and Rosenshine (1977) 
make a number of statements relative to the Stalllngs and Kaskowitz 
results, those three reviews are frequently cited in the discussion of ' 
the findings. \ 

Understanding^ the Tables \ 

Each of the following tables, designed to summarize the reanalysls 
re«ults for one of the constructs listed above, contains the following 
data: (1) a description of the process variable, (2) correlational data 
relating process variables to mathematics achlevemetit, and (3) correla- 
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tional dati. relating process variables to reaoing achievement. In the 
"process variables" columns, variable names and identifying numbers 
(which are the same as those foui^d. in the S tailings and Kaskowitz report) 
are presented along with the mean, the standard deviation, and the range 
tor tue listed process variable. The subscripts "a" and "c" attached to 
Home of the iuentifying numbers represent either an adult- or child-fo- 
cui, relative to classroom observations. 

Presented in columns headed "r" are correlation coefficients re- 
presenting the association between process variables and mathematics 
or reading residual scores. A coefficient of ± .19 or larger is sig- 
nificant at the p < .05 level. A single coefficient indicates that the 
;'ero-order correlation computed in the reanalysis was identical to 
Stallings and Kaskowitz's partial correlation coefficient. If two coef- 
ficients are listed, they are in the form "secondary analysis result/primary 
analysis result," and indicate a discrepancy between the results of the 
primary and secondary analyses. If a relationship was found' to be 
nonlinear, the highest power term entered in the best-fit cing regression 

equation is noted in the column headed "Degree"; the symbols x, x^, x'^, 
4 

and X represent linear, quadratic, cubic, and quartic equations, re- 
spectively. The shapes of curvilinear functions, reproduced from computer- 
generated scatterplots through xerography, are also Illustrated in the tables. 
Multiple regression correla«:ion coefficients that are significant at the p .05 
level are presented in "R" columns. The computer scattergram plots are 
themselves provided for in figures located either throughout the body of this 
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aect on or in' the Appendix* Linear functions are not illustrated on the 
caart; their slope can be determined, however, from the "r" coefficient* 

Time 

IL is widely acknowledged that time is one of the more important 
factors influencing student acliievement in reading and mathematics* 
For example, time is the central element of Carroll *s (1963) schooling 
model and o£ the Wiley and Uamischfeger (1974) model. In the Cooley 
and Lohnes (1976) model, time is the major component of their '^opportunity 
construct. 

Recently, many researchers hauie begun to distinguish between the 

absolute time spent in school (which is calculated from such indices 

I* 

'^s average daily attendance, length of school day, and length of school 
year) and the use of time in the classroom (Berliner & Rosenshine, 1977; 
Gov, 1977; Medley, 1978; Rosenshine, 1976, 1977). Two of the Stallings 
and Kaskcwitz variables that were reanalyzed fall under the ^^time" con- 
struct. These are the percent of the school day the child spent on 
task-related mathematics or reading activities, that is, "percent of 
Ciiild time spent in numbers, math, arithmetic (66)" and "percent of 
child time spent in reading, alphabet, language development (67)." 

Table 1 indicates that the percent of child time spent in mathe- 
matics activities has a curvilinear relationship with mathematics 
residual mean scores, but that the percent of child time spent in reading 
iicttvities has a high positive linear relationship with reading residual 
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Table 1 

Summary of Process-Product Relationships; Time 





t Process Vnri< 


iiblcs 


MAthcmatics 


Reading 


No. 




Mean 


S.D. 


Range 


r 


R 


Degree 


Shape 


r 


K 


Degree 


Shap« 


66 


Percent of "child dme" 
«pent on nunbers. iiach» 
•rlthoietic accivicles 


16.43 


8.06 


0.0 - 
57.9 


.28/.29 


.37 








.41 


X 




67 


Percent of "child tine" 
•penc on reading, alpha- 
bee, language devclop- 
M^lt^ Mrtivirlea 


44.72 


15.40 


13.07 - 
76.65 


.18 








*40 




X 


• 



4S 



*A11 "r" coefficients of t .19 or above are significant at the p < .05 level 
significant at the p < .05 level. * -Level. 



All "R" coefficients are 
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mean scores. Figure 1 appears to indicate that as the percent of time 
spent In mathematics -type activities increases » so does mathematics 
achievement^ until a peak is reached when about 30 percent of the school 
day is devoted to such activities; thereafter, students' math achieve- 
ment decreases as the percent of tlioe spent on mathematlc8-*related acti- 
vities Incretises. The optimum -aiaount of time for first grade children's 
work on aathematlcs-related actl^^ seen* to„be alw^ 
of a school day; more time than this appears to have diminishing 
marginal, utility. . .... 

Reading achievement findings agree with earlier results and 
support the conclusion of the primary analysis; that. 'i8» "children who 
performed well on tests of reading . . . deemed to be in classrooms 
where more time was spent in developing academic skilXa" (Stallings 
and Kaskowltz, 1974 « p. 300). It also is in agreement with both Rosen- 
shine *s (1976) statement, "the stronger the academic emphasis, the 
stronger the academic results" (p. 343), and with findings that greater 
amounts of instructional reading time were beneficial for low-SES 
children (Guthrie, in press) . 

On the other hand, the curvilinear relationship found to exist be- 
tween time spent on mathematics-related activities and mathematics 
achievement seems to be more in keeping with the research findings of 
the Soars (Soar, 1973, Soar & Soar, 1976), rather than with the Rosen- 
shine and Stallings and Kaskowitz statements reported above. The Soars 



• 44 

4y 




Figure i . The process-product function for "percent of child time 
on numbers, math, arithmetic" (M/66) . 
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suggest that Increasing the amount of time spent on academic activities 
bfiyon^ a certain point may produce only marginal returns. The quadratic 
curvilinear relationship between mathematics achievement and time spent 
\^ - on mathematics-related activities seems to go beyond Soars' interpre- 

^ tatlon. However, it should be noted that the function, which is categor- 

ized here as an inverted U shape, appears to result from data from one 
outlier classroom. If this 'outlier clasiv. om is disregarded, the resulting 
function undoubtedly would be linear* This suggests that the inverted 
IJ function reported here needs to be confirmed by additional data* 

Instructional Organization 

Ruff (1978) used "instructional organisation" to refer to the way 
tea.:hers group students for instruction. In this study, Stallings and 
Kaskowitz identified four basic grouping patterns: one child, two chil- 
dren, small group (three to eight children), and large group (nine or 
more children). Seven of the fourteeh process variables assigned to this 
category are from Stallings and Kaskowit^^s original set of variables; 
the remaining seven have been newly aggregated f.ot this reanalysis.^ The 
original variables are the first seven listed in Table 2. Newly aggre*- 
gated variables are listed in the next half of the Table and have the 



Due to budgetary and time constraints, the authors determined that they 
could not reanalyze separate"^^ all of the Stallings and Kaskowitz vari- 
ables associated with this category. As an alternative, they elected to 
establish indices by combining dimensionally related items; e.g., vari- 
ables 86 (Teacher with one child), 87 (Teacher with two children), 
88 (Teacher with small group), and 89 (Teacher with large group) were 
combined Into one Inaex called "Classroom groupings: teachers-individual 
child interaction time." 
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Table 2 

Summary of Process-Product Relationships: Instructional Organization 





Prociftsf Var5,nl 


^GS 


Machcmaticd 


Readluft 


No, 


None 


Mean 


S.D. 


Range 


r 


R 


Degree 


Shape 


r 


R 


Oegcec 


Sh*ipe 




LnlXu/Tcacner ana Aice 
Ratio 


11.06 


5.30 


4.11 - 


.08/. 09 




X 




.11 


.29 


3 

X 

• 




109 


One child with any aUulc 




1.5? 


0.0 - 

O* J/ 


-.20 


.39 


2 

X 




-.33 




X 




140 


Total vtlght in nath 
grouping!! 


213.86 


130. U 


0.0 - 
891.67 


.35 


,47 


2 

X 




,22 


A 


3 




142 

t 


All chlltir«n wichouk. 
a<lult9 in Hath 




Oh (M 
«o • u / 

t 


n n . 
84,78 


iO 




X 




-.20 










Total weight in reading 
group in^a 


57'. 44 


268.15 


1.75 - 
13.00 


.31/ S 




X 




.40/ 5 




n 




164 


Personalized instruction 
without adults in 
reading 


3.82 


4,49 


0.0 - 
22.00 


-.22 




X 




-.36/ § 




X 




165 


All children without 
adults in reading 


7,73 


77.00 


0.0 - 
80.00 


-,01 


.36 


4 

X 


-.08/ § 


.34 






VI 


Classroom groupings: 
Percent of teacher- 
individual child 
Interaction time 


23.75 


11,47 


5.61 - 
61.25 


-.30/u> 




X 




-,i2/w 


.40 


3 

X 




V2 


Classroom groupings: 
Percent o( adult* 
inaivtauai cniia 
interatlon time 


23.52 


9.98 


7.26 - 
5?. 67 


-.22/w 


.34 


x2 




-.26/w 




X 





Table ? (cont.) 

Summary of Process-Product Relationships: Instructional Organization 



Process Variables 


MnthcmaClcs 


HiMdlng 


. No. 


1 

1 •'♦^ 1 


Mean ] 


S.D. 


Range 


r 




Degree 


Shape 


r 


R 


Degree 


Shape 


V3 


Classroom 2roU|>lni;s: 
Percent of child- 

V iOC 


12. U 


3.30 


7.13 - 
21.90 


■13/u) 




X 




.07/ u) 




X 




V5 


!tath j»rou;ilnftR: Percent 
of tcacher-^indlvldual 
child Interaction Ximtt 


5.3a 


4.46 


0.0 - 
20.35 


-.06/03 


.2? 






-•06/ uj 




X 




V6 


liAtti 4;rouplngs: Percent 
of child -any ACult 
Interaction tinte 


13.40 


5.33 


0.0 - 
25.00 


-.05/01 




X 




••12/ U) 




X 




V7 


Reading f.touplnf.Ht Per- 
cent of teacher-ind^ /id- 
ual child interaction 
tiae 




2.50 


1.25 - 
14.59 


-.18/w 


.26 


4 

X 




-.19/ u 


.29 


4 

X 


« 


■ J 


Reading groupings; l^er- 
cent of cMld-any adolt 
interaction time 


13.14 


4.35 


4.11 - 
22.50 


.04/(0 


.16 






-,06/w 




X 





*A11 •*r" coefficients of ± .19 or above are significant at the p < .15 level. All **R*' coefficients 
are significant at the p < ,05 level. 

III is variable is a new composite and was not studied as such in the primary analysis. 

; Stall Imp/; and Kaskc^wllz did nc; report these partial correlation coefficients* 



prefix "V" attached to their code listing. Ttie first three aggregates, 
(VI, V2, and v:j) are related to Classroom g.rouping8 for all-day activi- 
ties, the next .two (Vi aiid V6) are related to math groupings, and the 
last two (V7 and V8) are related to reading groupings. An arbitrary 
Weighting system was used in aggregating variables: the sum of .(per- 
cent of the time an adult was with one child ), one-half of (percent 
oi t.ho time an adult was with two children ), one-fifth of (percent of 
tine iui adult was with a small group ), and one-ninth of(percent of 
time, an adult was with a large group). The results of the reanalysis 
ot these fourteen variables are summarized in Table 2. It should be 
noted tnat this secondary analysis was not overly concerned with a 
close examination of the relationship between mathematics-related 
process variables (i.e. mathematics groupings) and reading achievement, 
nor with the relationship between reading-related process variables 
(i.e., reading groupings) and mathematics achievement. Attention 
instead was focused on an examination of the relationship between 
coatijnt-related process variables and achievement in that content area. 

Seven out of the nineteen relationships between instructional 
organization variables and student achievement upon which the reanaly- 
sis was primarily focused revealed best-fit functions that were curvi- 
iiuear* 3oLh percent of tiue one child was with any adult (var. 109) 
Ci,ee Mgure 2) and the weighted percent of time .adults spent with 
children (var* V2) (see Figure 3) were found to have upright U-shaped curvi 
linear relationships with mathematics achievement • This indicates 
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Figure 3. The procesr-product function for "classroom groupings: percent 
of adult- individual child interation time" (M/V2) . 
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that» for au Individual child » either many child**adult contacts or none 
at all aeem to be associated with maximum mathematics achievements On 
the other hand» as shown In Figure A» the number of children Involved 
in mathematics on all of the observed days (var. lAO) has an Inverted 
shaped relation to mathematics achievement. Although Stalllngs and Kaskowltz 
reported that this variable "also had high positive correlations with all 
of the mathematics test scores** (p» 283), the present reanalysls results 
suggest that there may be optimum levels of child involvement in mathe- 
matics activities* i^owever, because an outlier again is Involved, these 
results must be regarded as tentative only* 

l*he relationship between mathematics achievement and the percent of 
time a teacher interacts with one child in any type of mathematics 
groupings (var* V3) is illustrated in Figure 5 as a cubic function* There 
is the possibility, though perhaps* a remote one» that the elimination of 
the outlier could res^ult in an inverted U curve* As it stands^ the data 
seem to Imply that there is an optimal level of time that a teacher 
could spend Interacting with a single child* But this relationship is in need 
of more study before conclusions can be drawn* 

Each of the following variables — child/teacher and aide ratio 
(var. 15), percent of time the teacher was with individual children (var# 
VI), and percent of time the teacher Interacted with one child In any type of 

reading groups (var* V7) — has a significant nonlinear relatlonshln with reading 
residual scores* Figure 6, which presents the relationship between 
chi Id/teachor and aide ratio (var* 15) and reading residual scores. 
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Figure 4. The process-product function for "total weight in math groupings' 
(M/UO). 6 H 6 
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Figure 5. The process-product function for "math groupings: percent of 
teacher-individual child interaction time" (M/V5). 
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shows that the optimum ratio is between fifteen and twenty-five children 
per teacher/aide. The cubic nature of this variable .avites caution in 
interpretation since the function itself maybe due to an interaction effect. 
Figure 7, which is descriptive of the relationship between the percent 
of "eacher time spent in interaction with individual children (var. VI) 
and reading residual scores, indicates that the optimum perc^it of 
teacher time that possibly should be spent in interaction with individual 
children is between 12 --24 percent per class day. The relationship 
between the percent of time, a child interacts with teachers in any type 
of reading group (var. V7) and reading lesidual scores (see Flguxe 8) . 
was found to fit a qiiartlc equation. While there seems to be a general 
trend for achievement to decline as the amount of teacher individual 
contacts increase » there are enough deviations from this trend to indicate 
the need for additional analysis. 

To date, the Stallings and Kaskowitz study has been a primary source 
of data for reviewers who attempt to synthesize study findings on 
teacher effectiveness or process-product research correlations between 
instructional organization variables and student achievement (e.f>., 
Berliner & Rosenohlne, 1977; Gow, 1977; Medley, 1978; Rosenshine, 1976, 
1977). These reviewers have generally indicated that instances of 
children working alone, or of one or two children working with the 
teacher or aide, were consistently negatively correlated with achieve- 
ment. These reanalysis results, however, reveal that mathematics achieve- 
ment increases as the percent of time one child is with any adult (var. 
109) or as the proportion of the time adults are with individual children 
becomes very large (i.e., above 50 percent) (var. V2). The reasons for 
these findings are 
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Figure 7. The procosH-product function for "classroom groupings: 
P*>r(Pnt of tParhpr-lndlvjdual rhilH Interaction tlmft" (R/Vl), 
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Figure 8. The process- product function for ''reading groups: percent 
of teacher-individual child interaction" (R/V7) . 

58 



65 



not all clear since the nonlinear cubic relatlonahlps found between aggre- 
gated variables and achievement are generally difficult to Interpret, This 
represents another set of relationships for vhich additional stufly Is needed. 

Monitoring 

.Monitoring is used here to refer to the supervising activities that 
teachers perform to maintain student on-task behaviors. A lack of j 
monitoring behavior ,on the part of the teacher is sometimes inferred ' 
from student behavior. The two process variables listed in Table 3 
for the monitoring construct, that is, "percent of time a child was 
without adults (V4)" and "child self -instruction, nonacademlc (599c)," 
are suggestive of a lack of teacher monitoring behavior. . Teachers may 
well object to such an assumption. 

The first of these variables (V4) is a composite of "one child 
without adults," "two children without adults," "small group of children 
without adults," and "large gjfoup of children without adults." This 
complex variable has a quadratic relation with residualized mathematics 

and reading scores that may be beat described as. upright partial U-shaped 

/ 

curves. As shown in Figures 9 and 10, the functions for l^oth mathematics 
and reading achievement indicate that residual scores drop rapidly with 
increases in the percent of time that children — regardless of groupings — 
are without adults; the scores level off at the 30 or 50 percent mark 
and show a very slight but perhaps not highly meaningful increase there- 
after. This process-product relationship is essentially a negative one, 
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Table 3 

Sunmary of Process-Product Relationships: 'Monitoring 



Process Variables 


Hathenatlce 


Readi ig 


No. 


None 


Mean 


S.O. 


Range 


r 


R 


Degree 


Shape 


r 


R 


Degree 


3hape 


V4 


?ercenc of tlue a child was 
vichout adults 


28.37 


14.83 


0.0 - 
56.80 


-.31/w 


.38 


2 

X 




-.30/0) 


.34 


2 

X 




599c 


Q«;id s«lf-insCruccion, 
nonacadealc 


4.57 


5.43 


0.0 - 
35.55 


.26 




X 




-.18 . 




X 





*A11 "r'* coefficients of ± .19 or above are significant at the n < .05 level. All "R" coefficients are 
significant at the p < •05 levels 

w: This variable is a new composite and was not studied as such in the primary analysis. 
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Figure 9. The process-product function for "percent of time a child was 
without adults" (M/VAh-as rclatt-d with mathematics achievement. 
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Flj?uro 10. The procoss-product function for "percent of time a child 
was without adults" (R/V4) — <is related with reading achievement. 

70 



The second variable, which is entitled "child self-^instruction, 
nonacademic*^ (var« 599c) is negatively and linearly related with 
residualized MT scores. 

Current research (e«g«» ilcDonald & £lias» '^976; Stallings & Kaskowitz 
1974), says Rosenshine (1977), "shows that unsupervised students are 
less academically engaged than supervised students" (p« 14). This fact. 
Ruff suggests, may parti, lly account for the negative correlations of 
lack of teacher monitoring with student achievement. The curvilinear 
results found here, especially because of their consistency across 
measures, should not De disregarded without further study. VJhile the 
results are not necessarily out of line with previous findings, the 
slight upward turn in student achievement with lack of "monitoring*' 
behaviors suggest that this variable may interact with other 
variables, or that the measure itself requires further refinement • 

Ilanagement 

According to Ruff, "management refers collectively to all the 
behaviors teacliers exhibit to form the ground rules by which instruction 
and interaction occur in the classroom" (p. 26), The process variable 
listed in Table 4 for this construct, that is, "adults involved in 
classroom management (V9)," is a composite representing the percent of 
occasions in which teacher^ aide, and volunteer were involved in class- 
room management. The correlation of this management variable with stu- 
dent achievement was low, negative^ and linear. 
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Table 4 

Summary of Process-Product Relationships: Management 





Process Variables 


Mathematics 


Reading 


No* 




Mean 


S.D. 




r 


K 


Degree 


Shape 


r 


R 


Degree 


Shape 


V9 


Adults Involved In class- 
roon managewnt 


8.40 


6.98 


0.0 - 
37.12 


-.07/u) 




X 




-.16/u) 




X 





* All "r" coefficients of ± .19 or above are significant at the p < .05 level. All "R" coefficients are 
significant at the p < .05 level. 



: This variable is a new composite and was not studied. as such in the primary analysis. 
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The fact that this composite is negatively related to ach:'.evement 
is consistent with previous findings. For example, Medley's (1978) re- 
view suggests that teachers whose students show the most growth tend 
to devote less time to maiiagement behaviors than teachers whose students 
are generally low achieving. 

Teacher Questioning 

The term "instruction" is suggestive of a variety of transactions 
that occur between teachers and students and between students and 
materials. Verbal interactions are but one aspect of those transactions, 
and teacher questioning is but one^ aspect of the variety of verbal ex- 
changes that may occur during instruction. The process variables listed 
in Table 5, that is, "adult academic commands /requests and direct questions 
to children (451a, 582c)" and "fdult open-ended questions to children 
(A52a, 583c)," reflect teacher questioning behavior with the observational 
focjis being either on the teacher or the child. 

Direct questioning is positively and linearly related to reading 
achievement, but curvilinearly related to achievement in mathematics. 
These relationships are consistent in that they hold regardless of the 
focus (adult or child) of the observation. The nature of the 
curvilinear functions for mathematics achievement may best be de- 
scribed as Inverted partial U-shapes. Figures 11 and 12 show that 
these curves are very similar in shape. Such a function suggests 
that increases In direct questioning behaviors (and in academic 
fommands/requests) are associated with increases in mathematics 
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Table 5 

Summary of Process-Product Relationships: Teacher Questioning 



?roc«s8 VarlAblcs 




Mathematics 








No. 


Norse 


Mean 


S.D. 


Range 


r 


R 


Degrct 


Shape 


r 


R* 




Shape 


< 




Adult «c«d«mic cominaiid«/ 
r«qu««cs and direct 
questions to children 


7.25 


3.39 


0.13 - 
15.31 


.25 


.30 


2 


/''^'"^^ 


.26 




X 








Adult acadenlc commands/ 
requests and direct 
questions to children 


2,15 


1.70 


0.0 - 

a. 80 ' 


.32 


.36 


2 

X 




.35 




X 






r 


Adult o,><n-cnd«d questions 
to children 


0.36 


0.3A 


0.0 - 
1.73 


-.03 




X 




-.08 




X 








Aiiult o;>Gn-»cndtd questions 
to children 


0.10 


0.21 


0.0 - 
1.50 


-.OA 




X 




-.05 




X 





*AU "r" coefficients of + .19 or above are significant at the p < .05 level. All "R" coefficients are 
significant at the p < ,05 level. 
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Figure 11. The process-product function for "adult academic commands /requests 
and direct questions to children" (M/45).a). 
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Figure 12. The process-product function for "adult academic commands/requests 
and direct questions to children" (M/582c). 
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achievement until some maximum Is reached; thereafter ^ they ar« asaocla^ 
ted with diminished marginal returns. The Implications of such functions 
are not unlike those for Inverted U shapes, thougHTless negative; tHoX 
ls> some moderate amount of direct questioning seems optimal and more 
is simply not more effective^ 

Table 5 also indicates that adult open-ended questions (vars, 452a 
and 583c) have near zero correlations with achievement as measured in this 
study* 

It is not fully clear how the 'Mirect question" variable relates to 
prior research. Medley (1978), for exaniple, indicates that effective 
teachers of low-SES pupils ask more lower order questions than ineffec- 
tive ones do. However, it seems fairly certain that the three facets of 
this variable — namely, commands, requests, and direct questions— 
occurred at such low frequency that StalXirgs and Kaskowitz probably 
had to combine them* More reseajch and/or analysis is required to 
understand better the meaning of these current findings* 

Teachers^ Reaction to Pupil Responses 

This construct is concerned with teacher behaviors during 
exchanges with students. The process variable listed in Table. 6, 
*'adult response to child's question with a question (453a, 584c), *^ with 
tWe focus either on the teacher or the child, appears to fall within this 
construct. i 

An examination of the linear correlations in Table t> reveals a low 
to near zero process-^product association for all four, correlations. 
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Table 6 

Summary of Process-Product Relationships: Teacher Reactions to Pupil Responses 





Process Variables 


Mathematics 


Residing 


No. 




Menn 




Range 


r 


R 


Degree 


Shape 


r 


R 


Dcr>ree 


Shape 




Adult r6s;>onso to child's 
<;uestlon with a question 


0*10 


0.15 


0.0 - 
0.78 


-•05/ § 




X 




.04/5 


.25 


2 

X 




,564c 


Adal?: response to child's 
^u^scioa with a question 


0.04 


0.07 


o.o - 

• 50 


\U § 




X 




.14- 









o 



*A11 "r" coefficients, of ± .19 or above are significant at the p < .05 level. All "R" coefficients are 
significant at the p < .05 level. 

5: Stallings and Kaskowitz did not report these partial correlation coefficients. 
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However t an upright partial U'-shaped nonlinear association was found 
between adult-focused observations on thia variable (var* 453a) and reading 
achievement. An examination of Figure 13, which displays the curve, 
suggests that there njay be a threshold effect; that is, this particular 
type'of teacher reaction seems not to be facilitative Initially, but 
does seem to become facilitative as the frequency of the behavior 
Increase. • 

Inverted U shapes, as well as negative and positive linear asso- 
ciations, have been found by Brophy and Evertson (1974a, 1974b) for 
reading achiv?.veraent and the process variable? "repeats, rephrases, or . ' 
asks new questions." The degree of relationship between current finding 
and those of Brophy and Evertson is difficult to assess, since the 
Stall ings and Kaskowltz variable is related only to one facet of the 
Brophy and Evertson variable. 

P upil Re spon se Patter ns 

Teacher-student interactions ir^rojve pupil rec'^t)nses as well as' 
teacher reactions. The process variables listed in Table 7, that is, 
•'all child open-ended questions (450a)", "child's extended response to 
questions (454a, 585c)," and "all child-cask related conunen.'-s (587c)" 
represent pupil response patterns. 

Curvilinear functions describe parts of all but one of the pupil 
response variables listed above. The all child open-ended questions 
(var. 450ii) has a low, negative, nonsignificant, linear association with 
reading achievement and a cubic association, which is largely uninterpretable 
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Figure 13, The procea.H-product function for "adult response to child 
question with a question" (R/453a). 
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Table 7 



Suratnary of Process-Product F^jlationships; Pupil Response Patterns 

* 



Process Variables 


1 Mathematics 


Rtiading 


No. 


Name 


Mean 


S.O. 


Range 


r 


R 


Degree 


Shape 


r 


• H 


Degree 


Shape 




ASOa 


All child open-ended 
questions 


0.01 


0.02 


0.0 - 
0.14 


-.10/-. 09 


.23 


3 

X 




-.17 

i 


1 

1 


X 




< 




Child's extended response 
to questions 


0.A6 


0.5A • 


0.0 - 
2.73 


.35 




X 




.21/ § 


• AO 


4 

X 






583c 


Child's extended response 
CO questions 


0.37 


0.29 


0.0 - 
1.15 


.26 


.34 


2 

X 




.02/ § 




X 






587c 


All <?hlld-task related 
cosMcents 


3.A6 


2.87 


0.11 ~ 
14.56 


-.03/-. 04 




X 




• 1 

-.07/ § 




X • 





*A11 "r" coefficients of ± .19 or above are significant at the p < .05 level. All "R" coefficients are 
significant at the p < .05 level. 



5: Stall Lngs and KasKowitz diJ not report these partial correlation coefficients. 
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with matheuiatics (see Figure 14). Since this behavior (var. A50a) occurs 
so infrequently* no firm conclusions can be drawn at this time. 

Hie child's extended response to quest ions /adult focus variable 
(var. 454a) has a moderate, positive, and linear association with mathe- 
matics achievement and a quartlc association with reading achievement' 
(see Figure 15). The child's extended response to questions/child focus 
variable (var. 585c) has a near zero association with reading achievement and 
a quadratic association with mathematics achievement. Figure 16 shows 
that this latter extended response variable is best described as a 
inverted partial U-shaped curve. Such a function suggests that increases 
in the number of children's extended responses to questions are associated 
with increases in mathematics achievement until some maximum is reached, 
and thereafter there are diminished returns 'in mathematics achievement 
gains. On the average, one extended recponse per class period seems 
sufficient to maximize outcomes; more than this seems to produce mildly 
reduced gains. The all child-task related comments (var. 587c), the 
last variable listed, appears to be unrelated to student outcomes. 

Rosenshine (1976), drawing primarily from Stallings and Kaskowitz's 
data, concluded that pupil responses to direct academic questions are. 
associated positively with achievement, whereas pupil responses to 
nonacaderalc and open-ended questions are negatively associated vith 
achievement. Tne results of the current reanalysis suggest thar. the 
relationships are much more complex. 
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Figure 14, The process-product function for "all child open-ended questions" 
(M/450a), 
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Figure 15, The process-product function for "child's extended 
to questions" (R/A54a) . 
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Figure 16. The process-product function for "child's extended response to 
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Te aching Activities / 

By teaching activities. Ruff (1978) means the types of instructional 
activities that occur. in the classroom, or what Rosenshlne (1976, 1977) 
and Berliner and Rosenshlne (1977) have discussed under the heading of 
'•ways of spending direct Instructional time/' 

Of the seven process variables listed in Table 8, only "variety of 
materials used (VIO)" — which is a composite of percent of time the 
following instructional materials were used in academic activities: 
TV, audiovisual equipment, exploratory materials, math or science equip- 
ment • tests, workbooks, and puzzles and games — showed a nonlinear re- 
lationship to achievements This variable has ^^^.correlation with 
mathematics achievement, but an inverted U--shape relationship with 
reading achievements Figure 17, which shows the functional relationship 
between this process variable and reading achievement, implies that in- 
frequent use of materials in general, as well as frequent use of a 
variety of materials, are both dysfunctional; tnoderate use of either 
a variety of materials or relatively frequent use of few materials — 
these Issues are confounded in the composite — ^appears to be optimal* 
This type of relationship does not appear to have been addressed by 
any reviewer and, therefore, will not be discussed further* 

Structure/Control 

Teachers differ in the degree to which they arrange instruction 
and control student freedom* Tikunoff, Berliner, and Rist (1975) define 




Table 8 

Summary of Process-Product Relationships: Teaching Activities 





Proceat V«rla] 


t>les 


Mathematics 


Reading 


No. 


.,1 


Mean 


S.D. 


Range 


r 


R 


Degree 


Shape 


r 


R 


Degree 


Shape 


44 


Total number different re- 
source caccgorles coded 
"present** over three 
daya 


21*02 


3.71 


0.0 - 
28.00 


-.03 

/ 




X 




-•19 




X 




AS 


TotAl nuAbi!r differfint r^— 
source categories coded 
"uaed today** over three 
days 


1 A AC 




0.0 - 
25.00 


-•03 




X 


• • 


-.10/5 




X 




82 


Wide variety of activl^ 
ties» concurrent 


1.84 


0.52 


0.98 - 
3,33 


-•06/- ,07 




X 




.. -.18 




X 

* 




Oi 


e^/^_ A. ^ 

Wide variety of activi- 
ties » over one day 


6.49 


1.83 


3.0 - 
11.33 


-.!?/-• 13 




X 




-.30 




X 




vio 


Variety of materials used 


15.51 


8.22 


1.19 - 
45.00 


-•08/ Ui 




X 




-.02/w 


.26 


2 

X 




471a 


Adults attentive to 
large group 


2.96 


2.99 


0.0 - 
14.84 


-•07 




X 




.02 




X 




586c 


All adult Instruction 


1.71 


1.11 


0.05 - 
6.25 


•08/ •OS 




X 




.12 




X 





coefficients of ± .19 or above arc significant at the p < .05 level. All "R" coefficients are 
significant at the p < .05 level. 

This variable a new composite and was not studied as such in the primary analysis. 

I 

5: Stallings and Kaskowitz did not report these partial correlation coefficients. 




Figure i7. The process-product function for ''variety of materials 
used" (R/VIO). , ^ 
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structure as;, "the teacher preparation of students for a particular 
lesson" (p. 382). Such teacher behaviors directly and/or indirectly 
control student beliavior. llie Stailings and Kaskowitz variable "child 
selection (24)" is a weighted aggregate of four variables, namely; 
(1) assigned seating for at least part of the day, (2) children select 
their own seating locations, (3) teacher assigns children to groups, 
and (4) cliildren select their own work groups. In general, the rela- 
tionship between child selection and achievement is a negative one 
(see Table 9) ; the association with mathematics is linear, and the 
association with reading is curvilinear, llie curvilinear function is 
described as a negatively accelerating curve (i.e.,*\ ). Figure 18 
shows that reading achievement does not decline until the weighted 
scale value exceeds 2 points; thereafter, the decline is quite steep* 
Soar and Soar (1976), in describing results across four studies, 
indicate that the relationship between teacher permissiveness and 
achievement is essentially curvilinear, with moderate amounts being 
optimal. fhe current results provide some support for their findings. 

Feedback 

Information in respect to tne correctness of a child's response or 
behavior Is treated as "feedback." Five process variables, as listed 
in Table 10, are exiimined in this reanalysis; the second and last two 
have both an adult and cl;ild focus: "adult neutral corrective feedback, 
academic (499a)," "all adult positive corrective feedback (457a, 588c)," 




Table 9* 

Sunsnary of Process-Product RelatiorshipH : Structure/Control 



Process Variables 


Mathcmar^ ':a 


Reading 




Nine 


Kean 


S.D. 


Range 


r 


R 


Degree 


Shape 


r 


R 


Degree 


Shipe 


24 


Child «eleccioa 


1.44 


1.79 


0.0 - 
/i.O 


-.09 




X 




-•26 


.36 


2 

X 





*An "r" coefficients of ± .19 or above are significant at the p < .05 level. All "R" coefficients are 
significant at the p < .05 level. 
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Table 10 v 
Summary of Process-Product Relationships': Feedback 



Process Vari 


ables 


Kachenatics / 


Reading 


^o • 




Kean 


s.o. 


Ronge 


r 


R 


Degree 


Shape 


r 


R ■ 


Degree 


Shapes . 




AUult neutral corrective 
feedback » academic 


0.69 


1.23 


0.0 ~ 
5.23 


.23 




X 




.23 


.32 


A 

X 




1 A57a 


All adulc positive cor** 
rectivi^ feedback 


2.A2 


1.20 


0.A5 - 
6.93 


. JO 




A 








X 






All adult positive coi- 
rcctlve feedback 


0.5 A 


O.AO 


0.0 - 
2.10 


.31 




X 




.15/ § 




X 




458a 


All adult negative cor- 
rective feedback 


0.15 


0.28 


0.0 - 
2.18 


.05/§ 




X 




-.lA/5 


.21 








Adult feedback to children 
for behavior 


1.31 


0.86 


0.03 - 
A. 35 


.03/ § 




X 




.09/§ 




X 






Adult tcedbaok to children 
for behavior 


0.28 


0.25 


0.0 - 
1.20 


.07/ § 




X 




-.08/ S 


.22 


2 

X 






All udalc neutral corrcc*- 
tive feedback 


1.56 


1.67 


0.0 - 
9.35 


.13 


.30 


4 

X 




.15/S 


.36 


4 

X 






All adult neutral correc- 
tive feeilback 


0.23 


0.29 


0.0 - 
1.60 


.10/ § 




X 




-.02/ § 




X 


1 



*A11 "r" coefficients of .19 or above are significant at the p < .05 level. All "R" coefficients are < 
significant at the p < .15 level. 



• : St.ilUny.s and K.iskowLt/. tJid not renorl these partial correlation coefficients. 



"all adult negative corrective feedback (458a)," "adult feedback to 
children for behavior (465a, 596c)," and "all adult neutral corrective 
feedback (470a, 601<:)," ' 

Tlie adult neutral, corrective feedback, acadamic variable (var . 499a) 
has a positive and linear relationship with mathematics achievement and 
a quartic"^ relationship that is largely uninterpretable with reading 
achievement (see Figure 19) •* The all adult positive corrective feedback 
variables (var* 457a, 588c) are linearly related to both reading and 
mathematics achievement* The all adult negative corrective feedback 
variabl*j (var. 458a) has a quartic relationship with reading achievement. 
The adult feedback to children for behavior/child--f ocus variable (var. 596c) 
which essentially has an upright U shape, implies. that moderate amounts 
of feedback for behavior are not academically facilitating, but extremes 
of the behavior are. It is unclear as to why this should be the case 
(see Figure 20). The all adult neutral corrective feedback/adult focus 
(var. 470a) has a quartic relationship with both mathematics and reading 
achievement; but such relationships cannot easily be interpreted. 

Rosenshine (.976, 1977) has indicated that in the Stallings and 
Kaskowltz study, both teacher praise and criticism are effective when 
academically focused. He also notes that teacher feedback is negative- . 
ly related to student achievement when nonacademically focused. This 
latter observation may be in need of reexamination, given the fact that 
an upright U-shaped function was found for "adult feedback to chlldien 
for behavior'' (var. 596c). 
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I'MKurc 20. The proi-oMs-prodm-t fum-tion for "adult feedback to children 
lor lu-lUiVlor" (H/'j'Jbr) . 
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4 

* / * *. Qualities of th^ Environment / ♦ 

Qualities of ffhe envlrotwnent refer to the affective climate of the 
classroom. Six process variables as listed in Table 11 are examined ' 
for this reanalysls; of these, the third and fourth variable have both 
an adult and child focus. The variables are as follows: "all child 
positive affect (460a)," "all positive -behavior (A62a),^* "child self- 
esteem '(466a, 597c)," "child cooperation (467a, 598c), "-"all negative 
behavior (594c)," and "child attentive (595c)." 

The all child positive affect, all positive behavior, and all 
negative behavior variables (vars. 460^, 462a, 594c) have a negative 
and linear relationship with achievement. 

Child self-esteem, both adult and child focused (vars. 466a, 597c), 
has a cubic relationship with both mathematics and reading achievement. 
Child self-esteem is an aggregate composed at least of child statements 
of self -worth and child *s extended response to questions; the latter 
itself is an aggregate, which only adds to the difficulty ot interpreting 
these outcomes. The functions displayed on Figures 21 and 22 suggest that 
some amount of child self-esteem prior to the raidrange is associated 
with relatively high achievement; surprisingly, increasing levels of 
"self-esteem" are associated with decreasing levels of growth, until 
some minimum is reached and an upward turn occurs. For reading achieve- 
ment, the highest, l-avels of "self-esteem" are associated with the greatest 
gains In achlevenent. It Is suspected that a number of variables are 
in interaction relative to this variable. 
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Table 11 

Sumuiary of Process-Product Relationships: Qualities of Eiivironroent 



00 





Process Variables 




Mathematics ' 


Reading 




Name 


Meon 


S.D. 


Range 




R 


Degree 


shape 


r 


R 


Degree 


Shape 




All child positive affect 


o.5;i 


0.73 


0.0 - 
4.57. 


-.11/5 




X 




-.06/§ 




X 






All poaitlve behavior 


l.U 


1.13 


0.0 - 
7.74 


-.15/§ 




X 




-.13/5 




X 


/ 




Child itelf-esceen 


6.67 


4.60 


1.00 
19.03 


-.17/5 


.29 


i 

X 




-.06/ § 


.31 


3 

x 


I"" 


Child 6»lf-es(eeiB 


6.S4 


4.65 


1.06 - 
19.24 


-.17/ § 


.28 


3 

X 




-.06/ § 


.35 


3 

X 






Child cocp^raClon 


1.58 


1.79 


0.0 - 
9.60 


.21 


.45 


3 

X 


J 


.13/5 


.46 


4 

X 


V 




Child cooperation 


3.A5 


2.96 


0.0 - 
14.72 


-.07/-. 03 




X 




-.07/-. 12 




X 






All Acgacive btfhavior 


0.25 


0.47 


0.0 - 
3.65 


.01/-. 11 




X 




• 

-.18 








59 >c 


Child attentive 


11.74 


5.67 


0.0 - 
27.50 


-.09/-. 07 


.33 


x^ 




-.12/§ 


.21 


2 

X 





*A11 'V" coefficients of t a9 or above are signif leant at the p < .05 level. All *'R" coefficients are 
slgniticant at the p ^ ,05 level. ^. 

: St<illinp,s .uid Kaskowit/. did not report these partial correlation coefficients. 



104 



105 



ERIC 




Figure 21. The process-product function for "child self -esteem" (M/597c>— as 
relar^f* with mathematics achievement. 
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Ftgure 22. The process-product function for "child self-esteem" 
(R/597c) — as related with reading achievement. 
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Figure 23. The process-product function for "child cooperation" (M/A67a) 
related with mathematics achlfcvement. 
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Figxire 24 . The process-product function for "child cooperation" (R/467a) — as 
related with mathematics achievement. 
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Child cooperation (vars. 467a» 598c) has a function not too unlike 
that of child self-esteem» with reading achievement; that is the highest 
levels of cooperation are associated with £he greatest growth in achieve- 
inent (see Figures 23 and 24) ♦ However, since the upward turn is due to 
a singj.e outlier, such an interpretation must be treated with great 
caution* and indeed without this case the func i might well approximate 
an inverted U shape. 

Child attentiveness (var. 595c) is cubicly related to mathematics 
achievement and has a quadratic inverted partial U-shaped relationship 
with reading achievement. An examination of Figure 25, which represents 
the relationship between child attentiveness and mathematics achievement, 
reveal» Laat this function is not unlike that for c^ild "self-esteem" 
in respect to reading achievement. Figure 26 shows that reading achieve- 
ment was maximal for classes having moderate amounts of child attention 
and that extremes of attentiveness were associated with decreasing amounts 
of student achievement. The fact that this^ariable is an aggregate of 
nonacademic and academic attention, as well as attention to. machines, adds 
a measure of difficulty to the interpretation of this finding. Apparently, 
too little and clearly too much attentiveness, especially if the latter 
is nonacademically oriented, is nonf acilitative. The reason for the 
upward turn for mathematics achievement is les.s clear. 

All variables listed in Table 11 have been dealt with in only 
cursory fashion in the literature; they are not the usual ones cate- 
gorized as "qualities of environment." The fact that they all are compo- 
sites clearly hinders efforts to compare these results with those of 
others. Nevertheless, the curvilinear findings suggest that this is still 
another set of relationships in need of additional study and research. 
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Figure 25. The process-product tunction for "child attentive" (M/595c)- 
rela<-pH vlth mathematics achievement. 
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Figure 26. The process-product function for **chlld attentive" (R/595c)— as 
relaf"'' "ith reading achievement. 
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VI. SUMMARY AND CONCLUSIONS 

Data from 108 first grade classrooms Included In the Stallings and 
Kaskowltz (1974) study were selectively reanalyzed using polynomial re-- 
gresslon analysis* This secondary analysis was conducted in order to 
search for possible nonlinear relationships between classroom process 
yariables and student achievement in reading and mathematics* 

Of ninety-five relationships initially selected for reanalysiS^ 
thirty-two were found to be nonlinear* Three of these nonlinear 
relationships have an inverted U shape » four are best described as 
inverted partial Us, one has a negatively accelerating shape (i.e., 
ano^iher has a negatively decelerating shape (i.e., ^ ), three have an 
upright U shape, another three are best described as upright partial 
Us, and the remaining functions were either cubic or c[uartic. Shapes 
referred to by Brophy and Evertson as'* candy canes'Wre not found in this 
reanal^sis. Some of the cubic and quartic functions could, if minor 
variation were disregarded, be treated either as inverted U or upright U 
shapes. All these npnllnear relationships are sxjmmarized in Table 12. 

Inverted U-shaped functions were found to describe the relationship 
between mathematics achievement and the following two process variables: 
"percent of time spent on numbers, math, arithmetic (66)i " and '*total 
weight in math groupings (140)'*; and between reading achievement and 
"variety of materials used (VIO)*'* Inverted partial Us best describe 
the relationships between mathematics achievement and the following 
process variables: *'adult academic commands/requests and direct 
questions to children (451a, 582c) and **child*s extended response to 
questions (585c;"; and between reading achievement and "child attentive 
(959c)." Brophy and Evertson indicate that inverted U-shaped curves: 
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Table 12 



Sununary of Nonlinear Functions 



Degree 


Shape 


Variables 


' Mathematics 


1 Reading 


Quadratic 

• 


Inverted U (/^^) 

Inverted Partial U (^^'■\/^) 


66(1)**. 

140(2) 
451a (5). 
582c (5). 


V10(8) ' . ' 
595c(ll) 


Positively Decelerating ( ) 
Negatively Accelerating ( ^ ) 




24(9) 


Negatively Decelerating ( ^ ) 
A.^08itively Acceleratinst ( ^ ) 






Upright Partial U (v^ ) 


V4(3) 

109(2). V2(2; 


V4(3). 453a (6) 
596c(10) 


Cubic 




V5+(2). 
43P«7) . 
466a (11>. 
597c (11), 
467a+(l 
595c (11) 


. 15+(2). 466a(ll), 
597c ai). 
467+(H), 
Vl+(2) 


Quartic 




470a (10) 


454AT7). 44S*.aO) 
45«a(10). 470a4+(10) 
V7(2) 



+: Minor variation of a basically inverted U shaped curve ♦ 

++: Minor variation of a basically U shaped curve, 

*: Brophy and -Evertson treated this type of curve as a 

decelerating curve even though in this reanalysis it had a 
cubic function. 

Numerals in parentheses refer to tables as found in Section V. 
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Dfepict a relationship In which some medium or optimal amou?it 
of the . . . process variable is associated with highest scores on 
the product criterion variable, with either too little or too much 
of the . . . process variable being less desirable than the 
medium optimal amount, (p. 22) 

A negatively accelerating xtirv0"best"describes tTie relationship found 
between reading achievement and a weighted composite called "child 
selection" (see Figure 18). A negauivelv accelerating curve (i.e., "^) 
generally indicates that low levels of the process variable being examined 
are marginally facilitative, but with increased levels the process vari- 
able becomes increasingly dysfunctional; the decline is initially a 
gradua^one that becomes stpeper with every increment In the process varia- 
ble. A negatively decelerating curve may be used to describe relationships 
found between reading achievement and the variable "all children without 
adults in reading" (see Appendix, Figure D). A negatively decelerating curve 
(i.e.,V.) generally indicates that low levels of the process variable 
being examined are marginally facilitative, but with increased levels 
the process variable quickly becomes dysfunctional, until a point is reached 
where there is a near zero rate nf decline. However, in this reanalysis 
the latter-mentioned variable, that is, "all children without adults in 
reading (165)." is best described as an L-shaped curve. Such a function 
indicates that there is essentially a zero correlation between the two. 
variables for most levels on the process variable, usually with some 
exception. In this Instance, the shape was due to data from one extreme 
class. 

Upright U-shaped curves were found to describe the relationship 
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between mathematics achievement and the following - two variables: 
•'one child with any adult (109)" and **cla88room groupings: percetit of 
adult--individual child interaction time (V2)»" The same upright U shape 
rlescribes the relationship between reading achievement and '^adult feedback 
to children for behavior (596c)/' Upright partial U curves were found 
between mathematics and reading achievement and th6 ^'percent of time 
a child was without adults (V4)t'' and between reading achievement and 
''adult response to chlld^s question with a question (453a)." Upright 
U-shaped curves indicate that either low or high levels of the process 
variable tend to be associated with greater achievement galns« With only 
a few exceptions, relationships of this sort are hard to interpret. 
Brophy and Evertson feel that such curves "appear to be inherently uninter- 
pretable • . \ without other information about how a variable might be 
interacting with other variables" (p. 25). Since such relationships 
usually appear when the process variable is multidimensional (as in 
cases of aggregated variables) and/or when in interactions with context 
or other variables (Brophy & Evertson, 1976), such cases suggest the need 
for further study and analyses. 

Cubic or quartlc functions, which are even more difficult to inter- 
pret, were found for seven of the process variables as related to 
mathematics achievement. Ten process variables have a cubic or quartlc 
relationship with reading achievement. Five of these functions were 
basically minor variations of Inverted U-shaped functions, and one is 
basically an upright U-shaped function. Again, the mii^tldimensidnality 
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of the process variables end/or their interastiun with other variables 
quite possibly are responsible for the nature of these functions. 
Further analyses and studies are needed to understand the root causes 

The findings of this secondary analysis effort show that in some 
instances, similar curves were obtained for the same variable across 
content areas (i.e.* reading and mathematics) and/or across adult- 
focused and child-focused data. This suggests that the results are 
consistent and have meaning ^ although that meaning may not always be 

readily apparent. On the whole, quadratic functions are more or less 

\ 

easy to Interpret, that Is, glvenja straightforward process variable and 
not a composite. In general, roost of the nonlinear quadratic relation- 
ships found through the present reanalysis, especially those described 
as inverted Us, inverted partial Us^ and/or accelerating and decelera-- 
ting curves, seem generally to be interpretable and, therefore, may be , 
said to proviJe more worthwhile information than linear rel^Jtionships 
alone. 

Several cautionary remarks seem due at this points First, Cronbach 
(1976) has cautioned against instigating a blind search for nonlinear 
relationships: "Nonlinearitiea may reasonably be explored, but unless 
there is a rationale for predicting nonlinearity, little credence can be 
given a nonlinear relationship the first time it turns up" (p. 3.11). 
In response to Cronbach 's remarks, it is to be noted that the variables 
used in this reanalysis were selected on the basis of prior research 
findings and other theoretical considerations; it was not a random process 
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Second, as mentioned in the methodology section, class mean reading 
and loath scores were reslduallzed on cldsd mean WRAT scores because of 
existing conditions. It remains to be v^hown whether or not similar 
curves will obtain if the ichievement test scores are residualized at 
the student level. * 

Third, statements made in this paper regarding "optimal** levels of 
classroom practice were not intended to be applied Indlscriminantly; 
they are generallzable only to low-SES first grade children similar to 
the children studied by Stallings and Kaa^witz. In addition, these 
secondary r^analysis findings should be treated as being tentative and 
in need of confirmation. 

Fourth^ several of the reported nonlinear relationships are almost 
certainly caused by outliers. Without these outliers the functions would 
differ considerably. Some functions might even prove to be linear, (others 
quadratic) » forcing conclusions drawn here to be substantially 
modified. An extremely conservative approach to this analysis might have 
been to drop all outliers. This alternative was elected, and outlier 
data was treated as if they represented real ef - • • Soar and Soar (1976) 
have suggested that "perhaps researchers have been protected by teachers 
who have . . . not produced extreme amounts of the behaviors under study 
(p. 265). Perhaps some of the teacherfe in the Stallings and Kaskowicz 
study were not as protective of researchers as is usual of their colleagues. 
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APPENDIX: 
PROCESS-PRODUCT FUNCTIONS 
NOT INCLUDED IN SECTION V 
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Figure A. The process-product function for "percent of 'Vh^iH 

numbers, math, arithmetic" (R/66)-as related wUh re/dint a^'h'e^emenr"^ 
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Figure B. The process-product function for "total weight in oath grouplngti« 
(R/140). 
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Figure C . The process-product function for "all children without adults 
In reading" (M/165). 
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Figure D . The process-product function for " all children without adults 
in reading" (R/165). 
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Figure E, The process-product function for "reading groupings; percer.*: 
of teacher-lndlvldual child interaction time" (M/V7). 
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Flgura ?. Th« proceti-product function for "reading groupings: percent 
of chlld-eny adult Interaction time" (M/V8). 
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Figure G. The process-product function for "all adult negative 
corrective feedback" (R/458a) . 
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Figure H. The process-product function for "all adult neutral 
coT-ctlve feedback" (M/A70a). 
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Figure I. The process-product function for "all adult neutral 
corrective feedback" (R/A70a). 

^^2 




. The process-product function for "child self-esteem" (M/466a). 
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